00000001:02000400:0.0F:1783947270.793104:0:2965:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_hostid 00000001:02000400:0.0:1783947291.761240:0:3187:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1783947293.841414:0:3231:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 541 MB/s 00000001:01000000:0.0:1783947294.092376:0:3231:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 547 MB/s 00000001:01000000:2.0:1783947294.341644:0:3231:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2679 MB/s 00000020:02000000:2.0:1783947295.351331:0:3279:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_162_g6041613 00000400:02000000:2.0:1783947296.425028:0:3294:0:(api-ni.c:2768:lnet_startup_lndni()) Added LNI 192.168.203.132@tcp [8/256/0/180] 00008000:02000000:3.0F:1783947300.725845:0:3444:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1783947356.816734:0:5255:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing load_modules_local 00000020:01000004:1.0F:1783947366.585804:0:5778:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783947366.585824:0:5778:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1783947366.585968:0:5778:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000378f3c30 00000080:02000400:1.0:1783947366.585978:0:5778:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1783947366.592479:0:5778:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1783947366.592494:0:5778:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1783947366.592542:0:5778:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000041b7b55f) 00000020:00000080:1.0:1783947366.592561:0:5778:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1783947366.611120:0:5778:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1783947366.612107:0:5778:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1783947366.693817:0:5778:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1783947366.693860:0:5778:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783947366.693882:0:5778:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1783947366.694366:0:5778:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783947366.694403:0:5778:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1783947366.695129:0:5778:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783947366.695138:0:5778:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783947366.695149:0:5778:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20c3e53e78bb19f1 00000020:01000004:3.0:1783947366.695157:0:5778:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1783947366.695161:0:5778:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783947366.695166:0:5778:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000378f3c30 from MGS 00000020:01000004:3.0:1783947366.695170:0:5778:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783947366.695189:0:5778:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000009a3fcffe) 00000020:00000080:3.0:1783947366.695202:0:5778:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783947366.695301:0:5778:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000378f3c30 from MGS, refs=2 00080000:01000000:3.0:1783947366.695306:0:5778:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783947366.695311:0:5778:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20c3e53e78bb19ff 00000100:00100000:3.0:1783947366.695585:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1783947366.695789:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1783947366.695796:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1783947366.697440:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1783947366.697454:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1783947366.703269:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947366.704307:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1783947366.704317:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1783947366.710063:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1783947366.710076:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1783947366.711404:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1783947366.711442:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1783947366.715591:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947366.715599:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947366.715600:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947366.717588:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947366.717595:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947366.717596:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947366.718901:0:5778:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1783947366.722348:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1783947366.968779:0:5778:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2283 MB/s 00000001:01000000:2.0:1783947367.224203:0:5778:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3109 MB/s 00000001:01000000:0.0:1783947367.477124:0:5778:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 359 MB/s 00000001:01000000:2.0:1783947367.729068:0:5778:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 599 MB/s 00010000:00010000:1.0:1783947367.737579:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1783947367.745681:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1783947367.767053:0:5778:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1783947367.767070:0:5778:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783947367.767073:0:5778:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1783947367.767777:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783947367.767832:0:5778:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783947367.767888:0:5778:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1783947367.768058:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1783947367.768086:0:5778:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783947367.768690:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947367.768966:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783947367.768973:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783947367.769795:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783947367.769803:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783947367.770375:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783947367.770699:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1783947367.771992:0:5792:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1783947367.772097:0:5778:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783947367.772119:0:5778:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.132@tcp' 00000020:01000004:1.0:1783947367.772121:0:5778:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1783947367.772205:0:5778:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.132@tcp (typ=mgc) 00000020:00000080:1.0:1783947367.772222:0:5778:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.132@tcp (00000000028c156c) 00000020:00000080:1.0:1783947367.772239:0:5778:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1783947367.772321:0:5778:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003b60f8b9@MGC192.168.203.132@tcp: add connection 192.168.203.132@tcp at head 00010000:00010000:1.0:1783947367.772528:0:5778:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.132@tcp-0 is initialized 00000040:01000000:1.0:1783947367.772534:0:5778:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.132@tcp ctxt 1 is initialized 10000000:01000000:0.0:1783947367.773616:0:5793:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1783947367.773692:0:5778:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.132@tcp (uuid bd1bc210-0230-4aa6-83fc-f49c3e4a8eba) 00000020:00000080:1.0:1783947367.773709:0:5778:0:(genops.c:1406:class_connect()) connect: client bd1bc210-0230-4aa6-83fc-f49c3e4a8eba, cookie 0x20c3e53e78bb1a0d 00000100:00080000:1.0:1783947367.773720:0:5778:0:(import.c:510:import_select_connection()) MGC192.168.203.132@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783947367.773724:0:5778:0:(import.c:624:import_select_connection()) MGC192.168.203.132@tcp: import 000000003b60f8b9 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1783947367.773762:0:5778:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002fed8e85 x1870604319850624/t0(0) o250->MGC192.168.203.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783947367.773786:0:5778:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import bd1bc210-0230-4aa6-83fc-f49c3e4a8eba->MGS 00000020:01000004:1.0:1783947367.773808:0:5778:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1783947367.773812:0:5778:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1783947367.773822:0:5778:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000f5ce79f2) 00000020:00000080:1.0:1783947367.773831:0:5778:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1783947367.777232:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002fed8e85 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3310:1870604319850624:0@lo:250: 00000100:00100000:0.0:1783947367.779672:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947367.782635:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319850624 00000100:00100000:3.0:1783947367.782729:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319850624 00000100:00100000:3.0:1783947367.782773:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947367.782780:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abe9141a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1870604319850624:12345-0@lo:250: 00010000:00080000:3.0:1783947367.782806:0:5789:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from bd1bc210-0230-4aa6-83fc-f49c3e4a8eba@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:3.0:1783947367.782833:0:5789:0:(genops.c:1406:class_connect()) connect: client bd1bc210-0230-4aa6-83fc-f49c3e4a8eba, cookie 0x20c3e53e78bb1a1b 00000100:00080000:3.0:1783947367.784172:0:5789:0:(import.c:65:import_set_state_nolock()) 00000000788c126c : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947367.784267:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abe9141a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+5:3310:x1870604319850624:12345-0@lo:250: Request processed in 1486us (4599us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947367.784276:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947367.784341:0:3310:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.132@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783947367.784349:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.132@tcp: connect to target with instance 0 00000100:00080000:3.0:1783947367.784355:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.132@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783947367.784360:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783947367.784363:0:3310:0:(import.c:65:import_set_state_nolock()) 000000003b60f8b9 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783947367.784365:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783947367.784372:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783947367.784375:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002fed8e85 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3310:1870604319850624:0@lo:250: 00000100:00100000:1.0:1783947367.788147:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947367.788311:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1783947367.788317:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1783947367.791773:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1783947367.791805:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1783947367.792320:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1783947367.792326:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1783947367.793698:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947367.794010:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1783947367.794017:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1783947367.794733:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1783947367.794740:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1783947367.880647:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783947367.881042:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1783947367.881049:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1783947367.885588:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1783947367.885601:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1783947367.886576:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783947367.886751:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783947367.886756:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1783947367.897174:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783947367.897229:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1783947367.906392:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947367.907004:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783947367.907020:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1783947367.907867:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783947367.907875:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1783947367.908840:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783947367.909012:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783947367.909017:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1783947367.909799:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783947367.909807:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1783947367.962121:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783947367.962674:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783947367.962680:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1783947367.967608:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783947367.967624:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1783947367.968665:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783947367.968674:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1783947367.987502:0:5778:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1783947367.987538:0:5778:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1783947367.987544:0:5778:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.132@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1783947367.987713:0:5778:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.132@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783947367.987750:0:5778:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.132@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1783947367.987755:0:5778:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783947367.987757:0:5778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783947367.987758:0:5778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783947367.987759:0:5778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947367.987760:0:5778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947367.987761:0:5778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947367.987763:0:5778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783947367.987764:0:5778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783947367.987765:0:5778:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783947367.987767:0:5778:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783947367.987768:0:5778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947367.987770:0:5778:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783947367.987772:0:5778:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1783947367.987774:0:5778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783947367.987775:0:5778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783947367.987776:0:5778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783947367.987777:0:5778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947367.987778:0:5778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947367.987779:0:5778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947367.987780:0:5778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783947367.987781:0:5778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783947367.987782:0:5778:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783947367.987783:0:5778:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783947367.987784:0:5778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947367.987785:0:5778:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783947367.987819:0:5778:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783947367.987835:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000207f2cea pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319850752:0@lo:253: 00000100:00100000:3.0:1783947367.987905:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947367.987984:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319850752 00000100:00100000:0.0:1783947367.987992:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319850752 00000100:00100000:3.0:1783947367.988021:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 000000001c95909a going to sleep for 11 seconds 00000100:00100000:0.0:1783947367.988045:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947367.988053:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe73ec33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+5:5778:x1870604319850752:12345-0@lo:253: 20000000:01000000:0.0:1783947367.988114:0:5791:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783947367.988118:0:5791:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1783947367.988723:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783947367.989407:0:5791:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1783947367.989869:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947367.990888:0:5813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1783947367.991221:0:5791:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783947367.991225:0:5791:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1783947367.991230:0:5791:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1783947367.991233:0:5791:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1783947367.991247:0:5791:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1783947367.993886:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947367.994131:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1783947367.994144:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783947367.994189:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1783947367.994235:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1783947368.002240:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1783947368.002506:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1783947368.002518:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1783947368.002581:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1783947368.002590:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1783947368.002620:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1783947368.002625:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1783947368.002666:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1783947368.002710:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1783947368.002746:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1783947368.002751:0:5791:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1783947368.002765:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783947368.002964:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1783947368.002974:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783947368.003007:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1783947368.003037:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1783947368.003080:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1783947368.003091:0:5791:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1783947368.003162:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1783947368.003170:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783947368.003211:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1783947368.003246:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1783947368.003298:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1783947368.003308:0:5791:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1783947368.003387:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1783947368.003396:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1783947368.003454:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1783947368.003501:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1783947368.003650:0:5791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1783947368.003693:0:5791:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1783947368.003700:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1783947368.007008:0:5815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1783947368.007649:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1783947368.007685:0:5791:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.132@tcp for mdt 20000000:01000000:1.0:1783947368.007687:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.132@tcp (null) (null) (null) 00000040:00080000:1.0:1783947368.007739:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1783947368.007747:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783947368.007778:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1783947368.007785:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.132@tcp (null) (null) 00000040:00080000:1.0:1783947368.007826:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1783947368.007835:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1783947368.007866:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1783947368.007899:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1783947368.007965:0:5791:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783947368.007968:0:5791:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783947368.007972:0:5791:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783947368.007982:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783947368.007984:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1783947368.008011:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783947368.008014:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783947368.009008:0:5816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1783947368.009378:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1783947368.009916:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1783947368.009964:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1783947368.009984:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783947368.009986:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783947368.010809:0:5817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1783947368.011062:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1783947368.011102:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1783947368.011170:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1783947368.011184:0:5791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783947368.011186:0:5791:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1783947368.011192:0:5791:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1783947368.011194:0:5791:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1783947368.011199:0:5791:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1783947368.011205:0:5791:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1783947368.012080:0:5818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1783947368.012215:0:5791:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1783947368.028403:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1783947368.028580:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1783947368.028728:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1783947368.028751:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783947368.028769:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000609c435c/0x20c3e53e78bb1a22 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947368.028784:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000609c435c/0x20c3e53e78bb1a22 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947368.028793:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000609c435c/0x20c3e53e78bb1a22 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947368.028799:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000609c435c/0x20c3e53e78bb1a22 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947368.028817:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000609c435c/0x20c3e53e78bb1a22 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947368.028824:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000609c435c/0x20c3e53e78bb1a22 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947368.028830:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000609c435c already unused, calling callback (0000000064b6cb07) 00010000:00010000:3.0:1783947368.028833:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000609c435c/0x20c3e53e78bb1a22 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947368.028841:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000609c435c/0x20c3e53e78bb1a22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947368.028853:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000609c435c/0x20c3e53e78bb1a22 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947368.028859:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000609c435c/0x20c3e53e78bb1a22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947368.028865:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000609c435c/0x20c3e53e78bb1a22 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783947368.028882:0:5791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783947368.300941:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe73ec33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+5:5778:x1870604319850752:12345-0@lo:253: Request processed in 312882us (313029us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947368.300956:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947368.301073:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000207f2cea pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319850752:0@lo:253: 10000000:01000000:1.0:1783947368.301089:0:5778:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783947368.301092:0:5778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783947368.301093:0:5778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783947368.301095:0:5778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947368.301096:0:5778:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1783947368.301098:0:5778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947368.301099:0:5778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947368.301101:0:5778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947368.301102:0:5778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783947368.301103:0:5778:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783947368.301105:0:5778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947368.301106:0:5778:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783947368.301125:0:5778:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000378f3c30 from lustre-MDT0000 10000000:01000000:1.0:1783947368.301149:0:5778:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1783947368.301157:0:5778:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783947368.301162:0:5778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8b3c85974d40 10000000:01000000:1.0:1783947368.301166:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783947368.301173:0:5778:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8b3c85974d40 from 1 10000000:01000000:1.0:1783947368.301176:0:5778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783947368.301209:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: 0000000086af5c68/0x20c3e53e78bb1a29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.301218:0:5778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: 0000000086af5c68/0x20c3e53e78bb1a29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.301226:0:5778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: 0000000086af5c68/0x20c3e53e78bb1a29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947368.301245:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000c16d3d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319850880:0@lo:101: 00000100:00100000:1.0:1783947368.301280:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947368.301331:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cb3737d9 going to sleep for 11 seconds 00000100:00100000:2.0:1783947368.301398:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319850880 00000100:00100000:2.0:1783947368.301405:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319850880 00000100:00100000:2.0:1783947368.301484:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783947368.301509:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a34505a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+5:5778:x1870604319850880:12345-0@lo:101: 00010000:00010000:2.0:1783947368.301523:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947368.301536:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fa799d68/0x20c3e53e78bb1a30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1a29 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947368.301557:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fa799d68/0x20c3e53e78bb1a30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1a29 expref: 6 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947368.301567:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fa799d68/0x20c3e53e78bb1a30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1a29 expref: 6 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947368.301580:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fa799d68, rc 0) 00000100:00100000:2.0:1783947368.301619:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a34505a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+6:5778:x1870604319850880:12345-0@lo:101: Request processed in 113us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947368.301626:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947368.302007:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000c16d3d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319850880:0@lo:101: 00010000:00010000:0.0:1783947368.302021:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: 0000000086af5c68/0x20c3e53e78bb1a29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1a30 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.302028:0:5778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: 0000000086af5c68/0x20c3e53e78bb1a29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1a30 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947368.302086:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007305eff7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319851008:0@lo:501: 00000100:00100000:0.0:1783947368.302115:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947368.302145:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cb5d9cc2 going to sleep for 11 seconds 00000100:00100000:1.0:1783947368.302204:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319851008 00000100:00100000:1.0:1783947368.302209:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319851008 00000100:00100000:1.0:1783947368.302240:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947368.302246:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5977d8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+6:5778:x1870604319851008:12345-0@lo:501: 00000100:00100000:1.0:1783947368.302504:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5977d8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+6:5778:x1870604319851008:12345-0@lo:501: Request processed in 257us (387us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783947368.302511:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947368.302582:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007305eff7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319851008:0@lo:501: 10000000:01000000:0.0:1783947368.302607:0:5778:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783947368.302628:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: 0000000086af5c68/0x20c3e53e78bb1a29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1a30 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.302636:0:5778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: 0000000086af5c68/0x20c3e53e78bb1a29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1a30 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947368.302643:0:5778:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b3c85ce6800 10000000:01000000:0.0:1783947368.302711:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783947368.302716:0:5778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8b3c85ce6800 10000000:01000000:0.0:1783947368.302718:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783947368.302721:0:5778:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8b3c85ce6800 from 1 10000000:01000000:0.0:1783947368.302723:0:5778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783947368.302742:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: 000000003159f826/0x20c3e53e78bb1a37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.302748:0:5778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: 000000003159f826/0x20c3e53e78bb1a37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.302767:0:5778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: 000000003159f826/0x20c3e53e78bb1a37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947368.302780:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007305eff7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319851136:0@lo:101: 00000100:00100000:0.0:1783947368.302808:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947368.302826:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cb5d9cc2 going to sleep for 11 seconds 00000100:00100000:1.0:1783947368.303469:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319851136 00000100:00100000:1.0:1783947368.303477:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319851136 00000100:00100000:1.0:1783947368.303521:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783947368.303527:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087bb8b8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+6:5778:x1870604319851136:12345-0@lo:101: 00010000:00010000:1.0:1783947368.303539:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947368.303559:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aead7bb1/0x20c3e53e78bb1a3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1a37 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.303577:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aead7bb1/0x20c3e53e78bb1a3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1a37 expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.303586:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aead7bb1/0x20c3e53e78bb1a3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1a37 expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.303594:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aead7bb1, rc 0) 00000100:00100000:1.0:1783947368.303642:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087bb8b8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+7:5778:x1870604319851136:12345-0@lo:101: Request processed in 115us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947368.303728:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783947368.304010:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007305eff7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319851136:0@lo:101: 00010000:00010000:0.0:1783947368.304023:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: 000000003159f826/0x20c3e53e78bb1a37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1a3e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.304031:0:5778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: 000000003159f826/0x20c3e53e78bb1a37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1a3e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947368.304045:0:5778:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783947368.304059:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: 000000003159f826/0x20c3e53e78bb1a37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1a3e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.304065:0:5778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: 000000003159f826/0x20c3e53e78bb1a37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1a3e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947368.304072:0:5778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783947368.304077:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783947368.304082:0:5778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8b3c85ce6800 10000000:01000000:0.0:1783947368.304085:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783947368.304087:0:5778:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783947368.304090:0:5778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783947368.304108:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: 000000006b2c6ff7/0x20c3e53e78bb1a45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.304121:0:5778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: 000000006b2c6ff7/0x20c3e53e78bb1a45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.304128:0:5778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: 000000006b2c6ff7/0x20c3e53e78bb1a45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947368.304142:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007305eff7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319851264:0@lo:101: 00000100:00100000:0.0:1783947368.304175:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947368.304289:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cb5d9cc2 going to sleep for 11 seconds 00000100:00100000:2.0:1783947368.304327:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319851264 00000100:00100000:2.0:1783947368.304334:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319851264 00000100:00100000:2.0:1783947368.304369:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783947368.304376:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7cacb0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+7:5778:x1870604319851264:12345-0@lo:101: 00010000:00010000:2.0:1783947368.304384:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947368.304393:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e32fb643/0x20c3e53e78bb1a4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1a45 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947368.304407:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e32fb643/0x20c3e53e78bb1a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1a45 expref: 8 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947368.304415:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e32fb643/0x20c3e53e78bb1a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1a45 expref: 8 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947368.304553:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e32fb643, rc 0) 00000100:00100000:0.0:1783947368.304757:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7cacb0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+8:5778:x1870604319851264:12345-0@lo:101: Request processed in 382us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947368.304764:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783947368.305007:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007305eff7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319851264:0@lo:101: 00010000:00010000:2.0:1783947368.305018:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: 000000006b2c6ff7/0x20c3e53e78bb1a45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1a4c expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947368.305026:0:5778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: 000000006b2c6ff7/0x20c3e53e78bb1a45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1a4c expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947368.305091:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c3429f5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319851392:0@lo:501: 00000100:00100000:2.0:1783947368.305126:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947368.305197:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 000000004cd457cf going to sleep for 11 seconds 00000100:00100000:0.0:1783947368.305234:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319851392 00000100:00100000:0.0:1783947368.305239:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319851392 00000100:00100000:0.0:1783947368.305305:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783947368.305312:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063b2e14b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+8:5778:x1870604319851392:12345-0@lo:501: 00000100:00100000:0.0:1783947368.305583:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063b2e14b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+9:5778:x1870604319851392:12345-0@lo:501: Request processed in 272us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947368.305591:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947368.305675:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c3429f5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319851392:0@lo:501: 00000100:00100000:2.0:1783947368.305704:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c3429f5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319851520:0@lo:503: 00000100:00100000:2.0:1783947368.305751:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947368.305972:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 000000004cd457cf going to sleep for 11 seconds 00000100:00100000:3.0:1783947368.306067:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319851520 00000100:00100000:3.0:1783947368.306072:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319851520 00000100:00100000:3.0:1783947368.306097:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783947368.306103:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5e82d8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+9:5778:x1870604319851520:12345-0@lo:503: 00000100:00100000:3.0:1783947368.306259:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5e82d8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+9:5778:x1870604319851520:12345-0@lo:503: Request processed in 157us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947368.306275:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783947368.306365:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c3429f5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319851520:0@lo:503: 00000100:00100000:2.0:1783947368.306851:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c3429f5b pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5820:1870604319851648:0@lo:502: 00000100:00100000:2.0:1783947368.306890:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947368.306920:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set 000000008f574edb going to sleep for 11 seconds 00000100:00100000:3.0:1783947368.306971:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319851648 00000100:00100000:3.0:1783947368.306976:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319851648 00000100:00100000:3.0:1783947368.306999:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783947368.307005:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b82a46e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+9:5820:x1870604319851648:12345-0@lo:502: 00000100:00100000:3.0:1783947368.307205:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b82a46e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+9:5820:x1870604319851648:12345-0@lo:502: Request processed in 200us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947368.307211:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783947368.307370:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c3429f5b pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5820:1870604319851648:0@lo:502: 00000020:01000000:2.0:1783947368.307392:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947368.307402:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947368.307405:0:5820:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783947368.307411:0:5820:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783947368.307414:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783947368.307452:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000d18ae28) 00000020:00000080:2.0:1783947368.307469:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1783947368.307475:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783947368.307595:0:5820:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783947368.307602:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20c3e53e78bb1a5a 00000020:00000080:2.0:1783947368.309308:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783947368.309318:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947368.309328:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947368.309330:0:5820:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783947368.309334:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947368.309339:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947368.309340:0:5820:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783947368.309355:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783947368.309367:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000bc332980) 00000020:00000080:2.0:1783947368.309384:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1783947368.309390:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783947368.309392:0:5820:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783947368.309395:0:5820:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1783947368.309400:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783947368.309479:0:5820:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000378f3c30 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1783947368.309500:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000aa8aa7be) 00000020:00000080:2.0:1783947368.309509:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1783947368.309564:0:5820:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783947368.309569:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20c3e53e78bb1a6f 00000020:00000080:2.0:1783947368.309700:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1783947368.309706:0:5820:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783947368.309711:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x20c3e53e78bb1a76 00080000:01000000:2.0:1783947368.309716:0:5820:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783947368.309720:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20c3e53e78bb1a7d 00080000:10000000:2.0:1783947368.310066:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1783947368.310238:0:5820:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1783947368.314098:0:5820:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1783947368.479957:0:5820:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1783947368.480262:0:5820:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1783947368.494991:0:5820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1783947368.495269:0:5820:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1783947368.535162:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000137eee90) 00000020:00000080:0.0:1783947368.535182:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1783947368.535239:0:5820:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783947368.535246:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20c3e53e78bb1a8b 00000020:00000080:1.0:1783947368.535783:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1783947368.538707:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1783947368.582265:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1783947368.608562:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1783947368.648083:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1783947368.681992:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1783947368.716992:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1783947368.758472:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x20c3e53e78bb1a92 00000020:00000080:2.0:1783947368.759291:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783947368.759303:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947368.759309:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947368.759312:0:5820:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783947368.759314:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947368.759318:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947368.759319:0:5820:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783947368.759322:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783947368.759330:0:5820:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783947368.759334:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947368.759336:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947368.759338:0:5820:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783947368.759340:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947368.759344:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947368.759345:0:5820:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783947368.759348:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783947368.759388:0:5820:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1783947368.759474:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c3429f5b pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5820:1870604319851776:0@lo:502: 00000100:00100000:2.0:1783947368.759568:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947368.759635:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set 000000008f574edb going to sleep for 11 seconds 00000100:00100000:3.0:1783947368.760059:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319851776 00000100:00100000:3.0:1783947368.760086:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319851776 00000100:00100000:3.0:1783947368.760447:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783947368.760456:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b765b94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+9:5820:x1870604319851776:12345-0@lo:502: 00000100:00100000:3.0:1783947368.761077:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b765b94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+9:5820:x1870604319851776:12345-0@lo:502: Request processed in 612us (1498us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947368.761086:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1783947368.761551:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947368.761782:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c3429f5b pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5820:1870604319851776:0@lo:502: 00000020:01000000:2.0:1783947368.761816:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947368.761822:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947368.761824:0:5820:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1783947368.761828:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1783947368.762016:0:5778:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1783947368.762034:0:5778:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783947368.762122:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: 000000006b2c6ff7/0x20c3e53e78bb1a45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1a4c expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947368.762166:0:5778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: 000000006b2c6ff7/0x20c3e53e78bb1a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1a4c expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947368.762175:0:5778:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8b3c85ce6800 from 1 10000000:01000000:3.0:1783947368.762178:0:5778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783947368.762237:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: 00000000609c435c/0x20c3e53e78bb1a99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947368.762245:0:5778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: 00000000609c435c/0x20c3e53e78bb1a99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947368.762254:0:5778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: 00000000609c435c/0x20c3e53e78bb1a99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947368.762284:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000010370460 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319851904:0@lo:101: 00000100:00100000:3.0:1783947368.762356:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947368.762395:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e57490e6 going to sleep for 11 seconds 00000100:00100000:0.0:1783947368.762481:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319851904 00000100:00100000:0.0:1783947368.762496:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319851904 00000100:00100000:0.0:1783947368.762538:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783947368.762545:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1bc5d13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+9:5778:x1870604319851904:12345-0@lo:101: 00010000:00010000:0.0:1783947368.762589:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947368.762602:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000086023510/0x20c3e53e78bb1aa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1a99 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.762622:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000086023510/0x20c3e53e78bb1aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1a99 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.762668:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000086023510/0x20c3e53e78bb1aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1a99 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.762678:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000086023510, rc 0) 00000100:00100000:0.0:1783947368.762745:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1bc5d13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+10:5778:x1870604319851904:12345-0@lo:101: Request processed in 200us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947368.762751:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783947368.763014:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000010370460 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319851904:0@lo:101: 00010000:00010000:2.0:1783947368.763029:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: 00000000609c435c/0x20c3e53e78bb1a99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1aa0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947368.763038:0:5778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: 00000000609c435c/0x20c3e53e78bb1a99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1aa0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947368.764294:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c3429f5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319852032:0@lo:256: 00000100:00100000:2.0:1783947368.764371:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947368.764411:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 000000008f574edb going to sleep for 11 seconds 00000100:00100000:0.0:1783947368.764579:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319852032 00000100:00100000:0.0:1783947368.764586:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319852032 00000100:00100000:0.0:1783947368.764631:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783947368.764646:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4fabca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+10:5778:x1870604319852032:12345-0@lo:256: 20000000:01000000:0.0:1783947368.764663:0:5791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783947368.764669:0:5791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1783947368.764750:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4fabca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+10:5778:x1870604319852032:12345-0@lo:256: Request processed in 112us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947368.764758:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947368.764883:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c3429f5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319852032:0@lo:256: 10000000:01000000:3.0:1783947368.765707:0:5778:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783947368.773028:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: 00000000609c435c/0x20c3e53e78bb1a99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1aa0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947368.773047:0:5778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: 00000000609c435c/0x20c3e53e78bb1a99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1aa0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947368.773055:0:5778:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3c85ce6800 from 1 10000000:01000000:3.0:1783947368.773058:0:5778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783947368.773094:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: 0000000040f79462/0x20c3e53e78bb1aa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947368.773114:0:5778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: 0000000040f79462/0x20c3e53e78bb1aa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947368.773125:0:5778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: 0000000040f79462/0x20c3e53e78bb1aa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947368.773147:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006caa211f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319852160:0@lo:101: 00000100:00100000:3.0:1783947368.773211:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947368.773292:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b7cac64c going to sleep for 11 seconds 00000100:00100000:2.0:1783947368.774503:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319852160 00000100:00100000:2.0:1783947368.774516:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319852160 00000100:00100000:2.0:1783947368.774584:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783947368.774592:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000723c6e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+10:5778:x1870604319852160:12345-0@lo:101: 00010000:00010000:2.0:1783947368.774608:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947368.774623:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000df56adca/0x20c3e53e78bb1aae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1aa7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947368.774648:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df56adca/0x20c3e53e78bb1aae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1aa7 expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947368.774657:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000df56adca/0x20c3e53e78bb1aae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1aa7 expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947368.774665:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000df56adca, rc 0) 00000100:00100000:2.0:1783947368.774729:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000723c6e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:5778:x1870604319852160:12345-0@lo:101: Request processed in 137us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947368.774736:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783947368.775275:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006caa211f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319852160:0@lo:101: 00010000:00010000:3.0:1783947368.775292:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: 0000000040f79462/0x20c3e53e78bb1aa7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1aae expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947368.775302:0:5778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: 0000000040f79462/0x20c3e53e78bb1aa7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1aae expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947368.775366:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006caa211f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319852288:0@lo:501: 00000100:00100000:3.0:1783947368.775401:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947368.775627:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b7cac64c going to sleep for 11 seconds 00000100:00100000:2.0:1783947368.775671:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319852288 00000100:00100000:2.0:1783947368.775677:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319852288 00000100:00100000:0.0:1783947368.775811:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783947368.775820:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa42d8c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:5778:x1870604319852288:12345-0@lo:501: 00000100:00100000:0.0:1783947368.776454:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa42d8c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:5778:x1870604319852288:12345-0@lo:501: Request processed in 634us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947368.776463:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783947368.776573:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006caa211f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319852288:0@lo:501: 00000100:00100000:3.0:1783947368.776609:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006caa211f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319852416:0@lo:503: 00000100:00100000:3.0:1783947368.776650:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947368.777052:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b7cac64c going to sleep for 11 seconds 00000100:00100000:2.0:1783947368.777191:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319852416 00000100:00100000:2.0:1783947368.777198:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319852416 00000100:00100000:2.0:1783947368.777231:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783947368.777238:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b8424f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:5778:x1870604319852416:12345-0@lo:503: 00000040:00080000:2.0:1783947368.777287:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783947368.777340:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b8424f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:5778:x1870604319852416:12345-0@lo:503: Request processed in 103us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947368.777346:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783947368.777452:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006caa211f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319852416:0@lo:503: 00000040:00080000:3.0:1783947368.778266:0:5824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1783947368.778537:0:5778:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1783947368.778556:0:5778:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783947368.778568:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: 0000000040f79462/0x20c3e53e78bb1aa7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1aae expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947368.778584:0:5778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: 0000000040f79462/0x20c3e53e78bb1aa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1aae expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947368.778623:0:5778:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783947368.778626:0:5778:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b3c85ce6800 10000000:01000000:2.0:1783947368.778628:0:5778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b3c85ce6800 10000000:01000000:2.0:1783947368.778632:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783947368.778637:0:5778:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b3c85ce6800 from 1 10000000:01000000:2.0:1783947368.778640:0:5778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783947368.778671:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: 000000009167a93f/0x20c3e53e78bb1ab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947368.778678:0:5778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: 000000009167a93f/0x20c3e53e78bb1ab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947368.778687:0:5778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: 000000009167a93f/0x20c3e53e78bb1ab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947368.778706:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000072f878cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319852544:0@lo:101: 00000100:00100000:2.0:1783947368.778753:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947368.778785:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b60a8c3f going to sleep for 11 seconds 00000100:00100000:2.0:1783947368.778817:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319852544 00000100:00100000:2.0:1783947368.778823:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319852544 00000100:00100000:2.0:1783947368.778853:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783947368.778859:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000027ca726 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:5778:x1870604319852544:12345-0@lo:101: 00010000:00010000:2.0:1783947368.778871:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947368.778884:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000adafcf89/0x20c3e53e78bb1abc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1ab5 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947368.778916:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000adafcf89/0x20c3e53e78bb1abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1ab5 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947368.778926:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000adafcf89/0x20c3e53e78bb1abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1ab5 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947368.778935:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000adafcf89, rc 0) 00000100:00100000:2.0:1783947368.778969:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000027ca726 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5778:x1870604319852544:12345-0@lo:101: Request processed in 110us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947368.778975:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783947368.779015:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000072f878cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319852544:0@lo:101: 00010000:00010000:2.0:1783947368.779026:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: 000000009167a93f/0x20c3e53e78bb1ab5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1abc expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947368.779034:0:5778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: 000000009167a93f/0x20c3e53e78bb1ab5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1abc expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947368.779076:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000072f878cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319852672:0@lo:501: 00000100:00100000:2.0:1783947368.779098:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947368.779110:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b60a8c3f going to sleep for 11 seconds 00000100:00100000:2.0:1783947368.779122:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319852672 00000100:00100000:2.0:1783947368.779126:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319852672 00000100:00100000:2.0:1783947368.779141:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783947368.779145:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f1f1f6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5778:x1870604319852672:12345-0@lo:501: 00000100:00100000:2.0:1783947368.779381:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f1f1f6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5778:x1870604319852672:12345-0@lo:501: Request processed in 234us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947368.779387:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783947368.779451:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000072f878cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319852672:0@lo:501: 00000100:00100000:2.0:1783947368.779476:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000072f878cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319852800:0@lo:503: 00000100:00100000:2.0:1783947368.779522:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947368.779550:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b60a8c3f going to sleep for 11 seconds 00000100:00100000:2.0:1783947368.779563:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319852800 00000100:00100000:2.0:1783947368.779567:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319852800 00000100:00100000:2.0:1783947368.779582:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783947368.779586:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b932b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5778:x1870604319852800:12345-0@lo:503: 00000100:00100000:2.0:1783947368.779854:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b932b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5778:x1870604319852800:12345-0@lo:503: Request processed in 267us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947368.779861:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783947368.779897:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000072f878cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319852800:0@lo:503: 00000100:00100000:2.0:1783947368.780051:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000072f878cb pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5825:1870604319852928:0@lo:502: 00000100:00100000:2.0:1783947368.780082:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947368.780099:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319852928 00000100:00100000:2.0:1783947368.780103:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319852928 00000100:00100000:2.0:1783947368.780119:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783947368.780123:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007680576c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5825:x1870604319852928:12345-0@lo:502: 00000100:00100000:2.0:1783947368.780998:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007680576c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5825:x1870604319852928:12345-0@lo:502: Request processed in 871us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947368.781007:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783947368.781048:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 00000000df386812 going to sleep for 11 seconds 00000100:00100000:2.0:1783947368.781063:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000072f878cb pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5825:1870604319852928:0@lo:502: 00000020:01000004:2.0:1783947368.781120:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1783947368.781134:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000007380839d) 00000020:00000080:2.0:1783947368.781153:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1783947368.781396:0:5825:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000378f3c30 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783947368.781400:0:5825:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000378f3c30 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783947368.781403:0:5825:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000378f3c30 4 00010000:00080000:2.0:1783947368.781455:0:5825:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004db1f0b3@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:2.0:1783947368.783688:0:5825:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1783947368.784154:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1783947368.784201:0:5825:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783947368.784215:0:5825:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x20c3e53e78bb1aca 00000100:00080000:2.0:1783947368.784225:0:5825:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783947368.784229:0:5825:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004db1f0b3 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1783947368.784264:0:5825:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000072f878cb x1870604319853056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783947368.784334:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000072f878cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1870604319853056:0@lo:38: 00000100:00100000:0.0:1783947368.784401:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783947368.784518:0:5825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783947368.784707:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319853056 00000100:00100000:1.0:1783947368.784715:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319853056 00000100:00100000:1.0:1783947368.784749:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947368.784755:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006aebaa84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1870604319853056:12345-0@lo:38: 00000100:00100000:1.0:1783947368.784936:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006aebaa84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1870604319853056:12345-0@lo:38: Request processed in 180us (534us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783947368.784945:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783947368.785002:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783947368.785009:0:3310:0:(import.c:65:import_set_state_nolock()) 000000004db1f0b3 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783947368.785013:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783947368.785016:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000072f878cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1870604319853056:0@lo:38: 00000100:00100000:0.0:1783947368.785734:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d135edbf pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5825:1870604319853184:0@lo:502: 00000100:00100000:0.0:1783947368.786646:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947368.786769:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 0000000019d6e2ea going to sleep for 11 seconds 00000100:00100000:1.0:1783947368.789639:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319853184 00000100:00100000:1.0:1783947368.789763:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319853184 00000100:00100000:1.0:1783947368.789853:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783947368.789861:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043091f30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5825:x1870604319853184:12345-0@lo:502: 00000100:00100000:1.0:1783947368.790238:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043091f30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5825:x1870604319853184:12345-0@lo:502: Request processed in 376us (3597us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947368.790246:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783947368.790862:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d135edbf pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5825:1870604319853184:0@lo:502: 00000040:00080000:0.0:1783947368.790900:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1783947368.791072:0:5778:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1783947368.791094:0:5778:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783947368.791118:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: 000000009167a93f/0x20c3e53e78bb1ab5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1abc expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.791128:0:5778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: 000000009167a93f/0x20c3e53e78bb1ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1abc expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783947368.791178:0:5778:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783947368.791180:0:5778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783947368.791181:0:5778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947368.791183:0:5778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947368.791184:0:5778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947368.791186:0:5778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947368.791187:0:5778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947368.791188:0:5778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783947368.791189:0:5778:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783947368.791191:0:5778:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783947368.791193:0:5778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947368.791195:0:5778:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783947368.791198:0:5778:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1783947368.791201:0:5778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783947368.791202:0:5778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783947368.791203:0:5778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947368.791205:0:5778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947368.791205:0:5778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947368.791206:0:5778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947368.791208:0:5778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947368.791208:0:5778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783947368.791209:0:5778:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783947368.791210:0:5778:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783947368.791211:0:5778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947368.791212:0:5778:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783947368.791236:0:5778:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783947368.791255:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087f3f4d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319853312:0@lo:253: 00000100:00100000:1.0:1783947368.791327:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947368.794761:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 0000000057109c10 going to sleep for 11 seconds 00000100:00100000:0.0:1783947368.795313:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319853312 00000100:00100000:0.0:1783947368.795326:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319853312 00000100:00100000:0.0:1783947368.795625:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783947368.795634:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5e292a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5778:x1870604319853312:12345-0@lo:253: 20000000:01000000:0.0:1783947368.795678:0:5791:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783947368.795786:0:5791:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783947368.843167:0:5791:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783947368.843187:0:5791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783947368.843245:0:5812:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783947368.843253:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783947368.843275:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002331e13b/0x20c3e53e78bb1ad1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.843296:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000086023510/0x20c3e53e78bb1aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1a99 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.843304:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002331e13b/0x20c3e53e78bb1ad1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.843360:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000086023510/0x20c3e53e78bb1aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1a99 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.843375:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000086023510/0x20c3e53e78bb1aa0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1a99 expref: 12 pid: 5790 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947368.843387:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d135edbf pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1870604319853440:0@lo:104: 00000100:00100000:0.0:1783947368.843479:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947368.843543:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b04792dd going to sleep for 11 seconds 00000100:00100000:1.0:1783947368.843623:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319853440 00000100:00100000:1.0:1783947368.843630:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319853440 00000100:00100000:1.0:1783947368.843687:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947368.843695:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d71053bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:5812:x1870604319853440:12345-0@lo:104: 00010000:00010000:1.0:1783947368.843707:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: 00000000609c435c/0x20c3e53e78bb1a99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1aa0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.843759:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947368.843764:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d71053bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:5812:x1870604319853440:12345-0@lo:104: Request processed in 70us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947368.843770:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1783947368.843816:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947368.843821:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: 00000000609c435c/0x20c3e53e78bb1a99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1aa0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.843829:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000609c435c already unused, calling callback (0000000045c62480) 10000000:00010000:1.0:1783947368.843832:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: 00000000609c435c/0x20c3e53e78bb1a99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1aa0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.843840:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: 00000000609c435c/0x20c3e53e78bb1a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1aa0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947368.843847:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: 00000000609c435c/0x20c3e53e78bb1a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1aa0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947368.843852:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947368.843880:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: 00000000609c435c/0x20c3e53e78bb1a99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1aa0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.843898:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947368.843915:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: 00000000609c435c/0x20c3e53e78bb1a99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1aa0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.843921:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: 00000000609c435c/0x20c3e53e78bb1a99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1aa0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.843939:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947368.843940:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947368.843942:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947368.844001:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004551cfb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319853568:0@lo:103: 00000100:00100000:1.0:1783947368.844031:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947368.844064:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319853568 00000100:00100000:1.0:1783947368.844068:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319853568 00010000:00010000:1.0:1783947368.844083:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000086023510/0x20c3e53e78bb1aa0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1a99 expref: 13 pid: 5790 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947368.844103:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947368.844109:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e9b3ede pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:3312:x1870604319853568:12345-0@lo:103: 00010000:00010000:1.0:1783947368.844118:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947368.844122:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000086023510/0x20c3e53e78bb1aa0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1a99 expref: 13 pid: 5790 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.844130:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000086023510/0x20c3e53e78bb1aa0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1a99 expref: 13 pid: 5790 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.844143:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002331e13b/0x20c3e53e78bb1ad1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.844158:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002331e13b/0x20c3e53e78bb1ad1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783947368.844172:0:5782:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000920105s 00010000:00010000:1.0:1783947368.844175:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002331e13b/0x20c3e53e78bb1ad1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.844182:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002331e13b/0x20c3e53e78bb1ad1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.844187:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002331e13b/0x20c3e53e78bb1ad1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.844193:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002331e13b/0x20c3e53e78bb1ad1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.844197:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002331e13b already unused, calling callback (0000000064b6cb07) 00010000:00010000:1.0:1783947368.844200:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002331e13b/0x20c3e53e78bb1ad1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.844206:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002331e13b/0x20c3e53e78bb1ad1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.844213:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002331e13b/0x20c3e53e78bb1ad1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947368.844221:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947368.844247:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e9b3ede pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:3312:x1870604319853568:12345-0@lo:103: Request processed in 139us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947368.844253:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947368.844294:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004551cfb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319853568:0@lo:103: 00010000:00010000:0.0:1783947368.844582:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000086023510/0x20c3e53e78bb1aa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1a99 expref: 12 pid: 5790 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947368.844594:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d135edbf pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1870604319853440:0@lo:104: 00010000:00010000:0.0:1783947368.844606:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002331e13b/0x20c3e53e78bb1ad1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.844614:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002331e13b/0x20c3e53e78bb1ad1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.844620:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002331e13b/0x20c3e53e78bb1ad1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.844625:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002331e13b/0x20c3e53e78bb1ad1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947368.851746:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5e292a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:5778:x1870604319853312:12345-0@lo:253: Request processed in 56106us (60413us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947368.851761:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783947368.851925:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087f3f4d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5778:1870604319853312:0@lo:253: 10000000:01000000:1.0:1783947368.851941:0:5778:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783947368.851944:0:5778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783947368.851946:0:5778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783947368.851947:0:5778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947368.851948:0:5778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947368.851949:0:5778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947368.851950:0:5778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947368.851952:0:5778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947368.851953:0:5778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783947368.851954:0:5778:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783947368.851955:0:5778:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783947368.851956:0:5778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947368.851958:0:5778:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783947368.851972:0:5778:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783947368.868280:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1783947368.870354:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783947368.871174:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1783947368.871404:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783947368.872322:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1783947368.872552:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1783947368.873973:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1783947368.874236:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1783947368.874628:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1783947368.875037:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1783947368.875315:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1783947368.877659:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1783947368.942308:0:5778:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1783947369.007559:0:5778:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1783947369.007826:0:5830:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1783947369.007831:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1783947369.008021:0:5831:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1783947369.011999:0:5778:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1783947369.012341:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783947369.012961:0:5778:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783947369.012970:0:5778:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783947369.013097:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783947369.014777:0:5778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783947369.015561:0:5778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783947369.015593:0:5778:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1783947369.015921:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1783947369.016179:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1783947369.018217:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1783947369.018980:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1783947369.020590:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1783947369.020763:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1783947369.021278:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1783947369.021877:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1783947369.022044:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1783947369.022636:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1783947369.022985:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1783947369.023275:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1783947369.023533:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1783947369.023663:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1783947369.026464:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1783947369.026639:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1783947369.026802:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1783947369.026936:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1783947369.027234:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1783947369.027395:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1783947369.029663:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1783947369.030015:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1783947369.031130:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1783947369.031320:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1783947369.031482:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1783947369.031660:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1783947369.033132:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1783947369.033392:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1783947369.034698:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1783947369.035265:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1783947369.035401:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1783947369.037028:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1783947369.037274:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1783947369.038036:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1783947369.038255:0:5778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1783947369.083528:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1783947369.162316:0:5778:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783947369.162350:0:5778:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb28681c6f988 00100000:10000000:2.0:1783947369.162357:0:5778:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1783947369.164363:0:5778:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783947369.164381:0:5778:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.132@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783947369.164395:0:5778:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783947369.164440:0:5778:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1783947369.170356:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783947369.170433:0:5831:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783947369.170442:0:5831:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1783947369.787253:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947370.809594:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947371.834988:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947372.861282:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947373.881539:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783947374.071778:0:6073:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1783947374.137551:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783947374.137558:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783947374.137561:0:8:0:(import.c:65:import_set_state_nolock()) 000000004db1f0b3 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947374.137573:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004db1f0b3 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1783947374.137593:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000021ea808d x1870604319853824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783947374.137697:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000021ea808d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1870604319853824:0@lo:38: 00000100:00100000:0.0:1783947374.137788:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947374.137861:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319853824 00000100:00100000:0.0:1783947374.137869:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319853824 00000100:00100000:0.0:1783947374.137948:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947374.137955:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000788df415 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1870604319853824:12345-0@lo:38: 00010000:00080000:0.0:1783947374.137977:0:5798:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:0.0:1783947374.138024:0:5798:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x20c3e53e78bb1ad8 00000004:00100000:0.0:1783947374.138062:0:5798:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783947374.138192:0:5798:0:(import.c:65:import_set_state_nolock()) 00000000b10350c9 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947374.138247:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000788df415 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1870604319853824:12345-0@lo:38: Request processed in 290us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947374.138254:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783947374.138300:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000021ea808d x1870604319853824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783947374.138326:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783947374.138333:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00100000:1.0:1783947374.138854:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d135edbf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319853696:0@lo:400: 00000100:00100000:1.0:1783947374.138894:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1783947374.138932:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783947374.138935:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8b3c85ce6800 from 3 10000000:01000000:1.0:1783947374.138938:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783947374.138965:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: 00000000f9867577/0x20c3e53e78bb1adf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947374.138974:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: 00000000f9867577/0x20c3e53e78bb1adf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947374.138982:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: 00000000f9867577/0x20c3e53e78bb1adf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947374.139004:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087f3f4d1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319853952:0@lo:101: 00000100:00100000:1.0:1783947374.139024:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947374.139036:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d811434c going to sleep for 11 seconds 00000100:00100000:1.0:1783947374.139048:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319853696 00000100:00100000:1.0:1783947374.139052:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319853696 00000100:00080000:0.0:1783947374.139090:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783947374.139093:0:3310:0:(import.c:65:import_set_state_nolock()) 000000004db1f0b3 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783947374.139096:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319853952 00000100:00100000:0.0:1783947374.139101:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000021ea808d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1870604319853824:0@lo:38: 00000100:00100000:1.0:1783947374.139108:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319853952 00000100:00100000:1.0:1783947374.139124:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783947374.139130:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf92022b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:3313:x1870604319853696:12345-0@lo:400: 00000100:00100000:1.0:1783947374.139172:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf92022b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:3313:x1870604319853696:12345-0@lo:400: Request processed in 44us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947374.139178:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783947374.139196:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783947374.139200:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000be94145 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:5793:x1870604319853952:12345-0@lo:101: 00010000:00010000:1.0:1783947374.139206:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947374.139215:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002333f9cf/0x20c3e53e78bb1ae6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1adf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947374.139230:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002333f9cf/0x20c3e53e78bb1ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1adf expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947374.139443:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002333f9cf/0x20c3e53e78bb1ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1adf expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947374.139598:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002333f9cf, rc 0) 00000100:00100000:1.0:1783947374.139629:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000be94145 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5793:x1870604319853952:12345-0@lo:101: Request processed in 428us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947374.139643:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783947374.139678:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087f3f4d1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319853952:0@lo:101: 00010000:00010000:1.0:1783947374.139689:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: 00000000f9867577/0x20c3e53e78bb1adf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1ae6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947374.139696:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: 00000000f9867577/0x20c3e53e78bb1adf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1ae6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947374.139734:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087f3f4d1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319854080:0@lo:256: 00000100:00100000:1.0:1783947374.139758:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947374.139774:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d811434c going to sleep for 11 seconds 00000100:00100000:1.0:1783947374.139783:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319854080 00000100:00100000:1.0:1783947374.139786:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319854080 00000100:00100000:1.0:1783947374.139804:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783947374.139808:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a846c1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5793:x1870604319854080:12345-0@lo:256: 20000000:01000000:1.0:1783947374.139818:0:5789:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783947374.139830:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783947374.139833:0:5789:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1783947374.139890:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a846c1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5793:x1870604319854080:12345-0@lo:256: Request processed in 82us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947374.139896:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783947374.139919:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087f3f4d1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319854080:0@lo:256: 10000000:01000000:1.0:1783947374.139948:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783947374.139953:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: 00000000f9867577/0x20c3e53e78bb1adf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1ae6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947374.139958:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: 00000000f9867577/0x20c3e53e78bb1adf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1ae6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947374.140185:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d135edbf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319853696:0@lo:400: 00010000:00010000:3.0:1783947374.906519:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947375.930859:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947376.954138:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947377.980867:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947379.002013:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947379.268864:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004551cfb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319854336:0@lo:400: 00000100:00100000:1.0:1783947379.268954:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947379.269021:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319854336 00000100:00100000:1.0:1783947379.269029:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319854336 00000100:00100000:1.0:1783947379.269088:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947379.269096:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003721af55 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319854336:12345-0@lo:400: 00000100:00100000:1.0:1783947379.269142:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003721af55 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319854336:12345-0@lo:400: Request processed in 48us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947379.269148:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783947379.269195:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004551cfb0 x1870604319854336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947379.269208:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004551cfb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319854336:0@lo:400: 00000100:00100000:2.0:1783947379.269339:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087f3f4d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319854208:0@lo:400: 00000100:00100000:2.0:1783947379.269375:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947379.271971:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319854208 00000100:00100000:1.0:1783947379.271987:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319854208 00000100:00100000:1.0:1783947379.272055:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783947379.272064:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b56f586 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:3314:x1870604319854208:12345-0@lo:400: 00000100:00100000:1.0:1783947379.272153:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b56f586 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:3314:x1870604319854208:12345-0@lo:400: Request processed in 90us (2778us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947379.272160:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783947379.272221:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087f3f4d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319854208:0@lo:400: 00000020:00000080:0.0:1783947379.526918:0:6275:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5e371260 20000000:00000080:0.0:1783947379.526936:0:6275:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b3c8823ec00 uarg=0000000000000000 20000000:01000000:0.0:1783947379.526981:0:6275:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1783947379.526987:0:6275:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1783947379.526991:0:6275:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1783947379.527344:0:6275:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1783947379.527355:0:6275:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1783947379.534206:0:6275:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947379.534531:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783947379.534593:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1783947379.534643:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1783947379.534660:0:6275:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783947379.534677:0:6275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c7d973a7/0x20c3e53e78bb1aed lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947379.534695:0:6275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000df56adca/0x20c3e53e78bb1aae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1aa7 expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947379.534704:0:6275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c7d973a7/0x20c3e53e78bb1aed lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947379.534739:0:6275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000df56adca/0x20c3e53e78bb1aae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1aa7 expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947379.534753:0:6275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000df56adca/0x20c3e53e78bb1aae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1aa7 expref: 11 pid: 5789 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947379.534774:0:6275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d135edbf pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6275:1870604319854464:0@lo:104: 00000100:00100000:0.0:1783947379.534835:0:6275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947379.534899:0:6275:0:(client.c:2702:ptlrpc_set_wait()) set 0000000003631439 going to sleep for 11 seconds 00000100:00100000:2.0:1783947379.536432:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319854464 00000100:00100000:2.0:1783947379.536444:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319854464 00000100:00100000:2.0:1783947379.536525:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947379.536533:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021ea808d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:6275:x1870604319854464:12345-0@lo:104: 00010000:00010000:2.0:1783947379.536550:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: 0000000040f79462/0x20c3e53e78bb1aa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1aae expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.536644:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783947379.536649:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021ea808d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:6275:x1870604319854464:12345-0@lo:104: Request processed in 118us (1814us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947379.536656:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1783947379.536677:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947379.536682:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: 0000000040f79462/0x20c3e53e78bb1aa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1aae expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.536689:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000040f79462 already unused, calling callback (0000000045c62480) 10000000:00010000:2.0:1783947379.536692:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: 0000000040f79462/0x20c3e53e78bb1aa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1aae expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.536710:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: 0000000040f79462/0x20c3e53e78bb1aa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1aae expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947379.536716:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: 0000000040f79462/0x20c3e53e78bb1aa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1aae expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947379.536721:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783947379.536754:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: 0000000040f79462/0x20c3e53e78bb1aa7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1aae expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.536760:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947379.536774:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: 0000000040f79462/0x20c3e53e78bb1aa7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1aae expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.536781:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: 0000000040f79462/0x20c3e53e78bb1aa7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1aae expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.536799:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947379.536801:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947379.536803:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947379.537011:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a42e7e5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319854592:0@lo:103: 00000100:00100000:1.0:1783947379.537054:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947379.539810:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319854592 00000100:00100000:2.0:1783947379.539825:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319854592 00010000:00010000:2.0:1783947379.539869:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000df56adca/0x20c3e53e78bb1aae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1aa7 expref: 12 pid: 5789 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947379.539905:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947379.539913:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087f3f4d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:3312:x1870604319854592:12345-0@lo:103: 00010000:00010000:2.0:1783947379.539928:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947379.539933:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000df56adca/0x20c3e53e78bb1aae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1aa7 expref: 12 pid: 5789 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.539957:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000df56adca/0x20c3e53e78bb1aae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1aa7 expref: 12 pid: 5789 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.539976:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c7d973a7/0x20c3e53e78bb1aed lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.539984:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c7d973a7/0x20c3e53e78bb1aed lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.540007:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c7d973a7/0x20c3e53e78bb1aed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.540013:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c7d973a7/0x20c3e53e78bb1aed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.540018:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c7d973a7/0x20c3e53e78bb1aed lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.540024:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c7d973a7/0x20c3e53e78bb1aed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.540030:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c7d973a7 already unused, calling callback (0000000064b6cb07) 00010000:00010000:2.0:1783947379.540033:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c7d973a7/0x20c3e53e78bb1aed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.540040:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c7d973a7/0x20c3e53e78bb1aed lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.540048:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c7d973a7/0x20c3e53e78bb1aed lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.540068:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947379.540148:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087f3f4d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:3312:x1870604319854592:12345-0@lo:103: Request processed in 236us (3093us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947379.540156:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947379.540247:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a42e7e5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319854592:0@lo:103: 00010000:00010000:0.0:1783947379.541339:0:6275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000df56adca/0x20c3e53e78bb1aae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1aa7 expref: 11 pid: 5789 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947379.541353:0:6275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d135edbf pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6275:1870604319854464:0@lo:104: 00010000:00010000:0.0:1783947379.541370:0:6275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c7d973a7/0x20c3e53e78bb1aed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947379.541378:0:6275:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c7d973a7/0x20c3e53e78bb1aed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947379.541383:0:6275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c7d973a7/0x20c3e53e78bb1aed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947379.541398:0:6275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c7d973a7/0x20c3e53e78bb1aed lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947380.025676:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947381.052007:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947382.074967:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783947382.399006:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783947382.399014:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3c85ce6800 from 1 10000000:01000000:2.0:1783947382.399019:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783947382.399060:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: 0000000038345f41/0x20c3e53e78bb1af4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947382.399072:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: 0000000038345f41/0x20c3e53e78bb1af4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947382.399081:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: 0000000038345f41/0x20c3e53e78bb1af4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947382.399102:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000edd1609e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319854720:0@lo:101: 00000100:00100000:2.0:1783947382.399168:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947382.399215:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a45d004 going to sleep for 11 seconds 00000100:00100000:1.0:1783947382.400691:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319854720 00000100:00100000:1.0:1783947382.400703:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319854720 00000100:00100000:1.0:1783947382.400765:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783947382.400773:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000962de95b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:5793:x1870604319854720:12345-0@lo:101: 00010000:00010000:1.0:1783947382.400787:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947382.400802:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006860d3ab/0x20c3e53e78bb1afb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1af4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947382.401553:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006860d3ab/0x20c3e53e78bb1afb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1af4 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947382.401572:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006860d3ab/0x20c3e53e78bb1afb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1af4 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947382.401582:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006860d3ab, rc 0) 00000100:00100000:1.0:1783947382.401651:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000962de95b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5793:x1870604319854720:12345-0@lo:101: Request processed in 879us (2482us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947382.401658:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783947382.402656:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000edd1609e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319854720:0@lo:101: 00010000:00010000:2.0:1783947382.402680:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: 0000000038345f41/0x20c3e53e78bb1af4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1afb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947382.402691:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: 0000000038345f41/0x20c3e53e78bb1af4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1afb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947382.402768:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000edd1609e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319854848:0@lo:501: 00000100:00100000:2.0:1783947382.402831:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947382.402872:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a45d004 going to sleep for 11 seconds 00000100:00100000:3.0:1783947382.402989:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319854848 00000100:00100000:3.0:1783947382.402996:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319854848 00000100:00100000:3.0:1783947382.403042:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783947382.403049:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d197fe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5793:x1870604319854848:12345-0@lo:501: 00000100:00100000:3.0:1783947382.403341:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d197fe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5793:x1870604319854848:12345-0@lo:501: Request processed in 292us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947382.403349:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947382.403757:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000edd1609e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319854848:0@lo:501: 00000100:00100000:2.0:1783947382.403790:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000edd1609e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319854976:0@lo:503: 00000100:00100000:2.0:1783947382.403900:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947382.403923:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a45d004 going to sleep for 11 seconds 00000100:00100000:3.0:1783947382.404955:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319854976 00000100:00100000:3.0:1783947382.404965:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319854976 00000100:00100000:3.0:1783947382.405019:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783947382.405027:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca4360f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5793:x1870604319854976:12345-0@lo:503: 00000100:00100000:3.0:1783947382.405366:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca4360f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5793:x1870604319854976:12345-0@lo:503: Request processed in 339us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947382.405374:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783947382.405585:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000edd1609e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319854976:0@lo:503: 00000100:00100000:0.0:1783947382.418877:0:6354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d135edbf pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6354:1870604319855104:0@lo:502: 00000100:00100000:0.0:1783947382.418953:0:6354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947382.418992:0:6354:0:(client.c:2702:ptlrpc_set_wait()) set 000000001480f271 going to sleep for 11 seconds 00000100:00100000:3.0:1783947382.419108:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319855104 00000100:00100000:3.0:1783947382.419115:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319855104 00000100:00100000:3.0:1783947382.419163:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783947382.419172:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048860c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:6354:x1870604319855104:12345-0@lo:502: 00000100:00100000:3.0:1783947382.419717:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048860c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:6354:x1870604319855104:12345-0@lo:502: Request processed in 545us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947382.419726:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783947382.419920:0:6354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d135edbf pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6354:1870604319855104:0@lo:502: 00000020:01000000:0.0:1783947382.419951:0:6354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947382.419961:0:6354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947382.419963:0:6354:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783947382.419976:0:6354:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b3c85ce6800 00000020:00000080:0.0:1783947382.419978:0:6354:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783947382.420025:0:6354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6354:1870604319855232:0@lo:502: 00000100:00100000:0.0:1783947382.420065:0:6354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947382.420099:0:6354:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c88216b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783947382.420150:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319855232 00000100:00100000:1.0:1783947382.420155:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319855232 00000100:00100000:1.0:1783947382.420196:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783947382.420203:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:6354:x1870604319855232:12345-0@lo:502: 00000100:00100000:1.0:1783947382.420352:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:6354:x1870604319855232:12345-0@lo:502: Request processed in 149us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947382.420359:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783947382.420745:0:6354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6354:1870604319855232:0@lo:502: 00000020:01000000:0.0:1783947382.420767:0:6354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947382.420771:0:6354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947382.420773:0:6354:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1783947382.420776:0:6354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1783947382.420916:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783947382.420938:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947382.420948:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ba00/0x20c3e53e78bb1af4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1afb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947382.420959:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ba00/0x20c3e53e78bb1af4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1afb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947383.097628:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947384.121754:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947384.378497:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319855360:0@lo:400: 00000100:00100000:1.0:1783947384.378570:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947384.378632:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947384.378638:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319855488:0@lo:400: 00000100:00100000:1.0:1783947384.378707:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947384.378745:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319855488 00000100:00100000:1.0:1783947384.378752:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319855488 00000100:00100000:1.0:1783947384.378819:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947384.378827:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319855488:12345-0@lo:400: 00000100:00100000:1.0:1783947384.378878:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319855488:12345-0@lo:400: Request processed in 51us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947384.378884:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783947384.378923:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b3c83372d80 x1870604319855488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947384.378936:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319855488:0@lo:400: 00000100:00100000:0.0:1783947384.379274:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319855360 00000100:00100000:0.0:1783947384.379279:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319855360 00000100:00100000:0.0:1783947384.379313:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783947384.379320:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:3313:x1870604319855360:12345-0@lo:400: 00000100:00100000:0.0:1783947384.379357:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:3313:x1870604319855360:12345-0@lo:400: Request processed in 39us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947384.379363:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783947384.382670:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319855360:0@lo:400: 00010000:00010000:2.0:1783947385.146971:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783947385.845040:0:6587:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783947385.845044:0:6587:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1783947385.845182:0:6587:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8b3cb6183000 00000020:01000004:1.0:1783947385.845198:0:6587:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1783947385.845209:0:6587:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1783947385.845222:0:6587:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8b3c85970000) 00000020:00000080:1.0:1783947385.845248:0:6587:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783947385.862613:0:6587:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1783947385.862847:0:6587:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1783947385.903158:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1783947385.918298:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783947385.918337:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1783947385.918415:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783947385.918461:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1783947385.920665:0:6587:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1783947385.920677:0:6587:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783947385.920689:0:6587:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x20c3e53e78bb1b09 00000020:01000004:2.0:1783947385.920697:0:6587:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1783947385.920718:0:6587:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.132@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783947385.920722:0:6587:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783947385.920728:0:6587:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1783947385.920733:0:6587:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1783947385.920828:0:6587:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8b3cbd3bb380) 00000020:00000080:2.0:1783947385.920844:0:6587:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1783947385.925853:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783947385.926272:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1783947385.926278:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1783947385.933479:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1783947385.933498:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1783947385.934898:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1783947385.934913:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1783947385.941376:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947385.943164:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1783947385.943172:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1783947385.947082:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1783947385.947095:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1783947386.008338:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783947386.013687:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783947386.013698:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1783947386.021089:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783947386.021108:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1783947386.022072:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783947386.022082:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1783947386.030257:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783947386.030491:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1783947386.030498:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1783947386.036310:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1783947386.036321:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783947386.135393:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783947386.136020:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783947386.136026:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1783947386.137581:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1783947386.137596:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1783947386.138246:0:6587:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1783947386.138268:0:6587:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1783947386.138274:0:6587:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.132@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1783947386.166318:0:6587:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.132@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783947386.166356:0:6587:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.132@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1783947386.166360:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783947386.166362:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783947386.166363:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947386.166364:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947386.166375:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947386.166377:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947386.166379:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783947386.166380:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783947386.166382:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783947386.166383:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947386.166385:0:6587:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783947386.166389:0:6587:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1783947386.166391:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783947386.166392:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783947386.166393:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947386.166394:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947386.166395:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947386.166396:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947386.166397:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783947386.166398:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783947386.166399:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783947386.166400:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947386.166401:0:6587:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783947386.166973:0:6587:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783947386.166994:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f53100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319855616:0@lo:253: 00000100:00100000:1.0:1783947386.167062:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947386.167209:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c83610780 going to sleep for 11 seconds 00000100:00100000:3.0:1783947386.169681:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319855616 00000100:00100000:3.0:1783947386.169697:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319855616 00010000:00010000:2.0:1783947386.170635:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947386.177049:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783947386.177073:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:6587:x1870604319855616:12345-0@lo:253: 20000000:01000000:3.0:1783947386.177128:0:5791:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783947386.177133:0:5791:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1783947386.177138:0:5791:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1783947386.177141:0:5791:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1783947386.179307:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783947386.180118:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1783947386.180136:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1783947386.180182:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1783947386.180190:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1783947386.180220:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1783947386.180270:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1783947386.182069:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1783947386.182100:0:5791:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.132@tcp 20000000:01000000:3.0:1783947386.182102:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.132@tcp (null) (null) (null) 00000040:00080000:3.0:1783947386.182138:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1783947386.182145:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783947386.182205:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1783947386.182214:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.132@tcp (null) (null) 00000040:00080000:3.0:1783947386.182249:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1783947386.182258:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1783947386.182288:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1783947386.182337:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1783947386.185125:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1783947386.185157:0:5791:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.132@tcp 20000000:01000000:3.0:1783947386.185160:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.132@tcp (null) (null) (null) 00000040:00080000:3.0:1783947386.185199:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1783947386.185207:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1783947386.185239:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1783947386.185247:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.132@tcp (null) (null) 00000040:00080000:3.0:1783947386.185297:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1783947386.185308:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1783947386.185344:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1783947386.185397:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1783947386.186685:0:5791:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1783947386.186692:0:5791:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1783947386.186711:0:5791:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1783947386.190639:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783947386.190647:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1783947386.190715:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783947386.190718:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783947386.192341:0:6602:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1783947386.192475:0:6602:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1783947386.192595:0:6602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1783947386.193206:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1783947386.193255:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1783947386.193288:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1783947386.193302:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783947386.193304:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783947386.195778:0:6603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1783947386.195948:0:6603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1783947386.196030:0:6603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1783947386.196396:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1783947386.196488:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1783947386.196721:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1783947386.196738:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1783947386.196741:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783947386.197241:0:6604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1783947386.197609:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1783947386.197655:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1783947386.197783:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1783947386.197800:0:5791:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1783947386.197802:0:5791:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1783947386.197810:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783947386.197828:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1b17 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.197844:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1a30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1a29 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.197863:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3ca9d1bc00/0x20c3e53e78bb1a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1a45 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.197869:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3ca9d1b000/0x20c3e53e78bb1abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1ab5 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.198019:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1b17 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.198057:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3ca9d1b000/0x20c3e53e78bb1abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1ab5 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.198069:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3ca9d1b000/0x20c3e53e78bb1abc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1ab5 expref: 12 pid: 5789 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947386.198082:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1870604319855744:0@lo:104: 00000100:00100000:2.0:1783947386.198152:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783947386.198245:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3ca9d1bc00/0x20c3e53e78bb1a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1a45 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.198254:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3ca9d1bc00/0x20c3e53e78bb1a4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1a45 expref: 12 pid: 5790 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947386.198262:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1870604319855872:0@lo:104: 00000100:00100000:2.0:1783947386.198284:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783947386.198650:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1a30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1a29 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.198659:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1a30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1a29 expref: 12 pid: 5789 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947386.198736:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1870604319856000:0@lo:104: 00000100:00100000:2.0:1783947386.198761:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947386.198838:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319855744 00000100:00100000:1.0:1783947386.198846:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319855744 00000100:00100000:1.0:1783947386.198894:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319855872 00000100:00100000:1.0:1783947386.198898:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319855872 00000100:00100000:1.0:1783947386.198913:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783947386.198920:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83374a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+4:5791:x1870604319855744:12345-0@lo:104: 00010000:00010000:1.0:1783947386.198934:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b200/0x20c3e53e78bb1ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1abc expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.198981:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947386.198987:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83374a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+4:5791:x1870604319855744:12345-0@lo:104: Request processed in 67us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947386.198993:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783947386.199008:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947386.199013:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83375500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:5791:x1870604319855872:12345-0@lo:104: 00010000:00010000:1.0:1783947386.199020:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1a4c expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.199053:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783947386.199057:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83375500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:5791:x1870604319855872:12345-0@lo:104: Request processed in 45us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947386.199062:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1783947386.199079:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947386.199085:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b200/0x20c3e53e78bb1ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1abc expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.199102:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1b200 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:1.0:1783947386.199105:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b200/0x20c3e53e78bb1ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1abc expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.199114:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b200/0x20c3e53e78bb1ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1abc expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947386.199122:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b200/0x20c3e53e78bb1ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1abc expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947386.199127:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947386.199156:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b200/0x20c3e53e78bb1ab5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1abc expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.199163:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947386.199179:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b200/0x20c3e53e78bb1ab5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1abc expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.199186:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b200/0x20c3e53e78bb1ab5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1abc expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.199200:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947386.199203:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1a4c expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.199210:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c80030e00 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:1.0:1783947386.199213:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1a4c expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.199229:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1a45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1a4c expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947386.199236:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1a45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1a4c expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947386.199241:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947386.199254:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1a45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1a4c expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.199260:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947386.199266:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1a45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1a4c expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.199272:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1a45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1a4c expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.199281:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947386.199282:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947386.199284:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947386.199302:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319856128:0@lo:103: 00000100:00100000:1.0:1783947386.199695:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947386.199737:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947386.199743:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319856256:0@lo:103: 00000100:00100000:1.0:1783947386.199764:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947386.199791:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319856128 00000100:00100000:1.0:1783947386.199796:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319856128 00010000:00010000:1.0:1783947386.199822:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3ca9d1b000/0x20c3e53e78bb1abc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1ab5 expref: 13 pid: 5789 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947386.199852:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319856256 00000100:00100000:1.0:1783947386.199855:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319856256 00010000:00010000:1.0:1783947386.199868:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3ca9d1bc00/0x20c3e53e78bb1a4c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1a45 expref: 14 pid: 5790 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947386.199892:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783947386.199900:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:3311:x1870604319856128:12345-0@lo:103: 00010000:00010000:1.0:1783947386.199909:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947386.199915:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3ca9d1b000/0x20c3e53e78bb1abc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1ab5 expref: 14 pid: 5789 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.199924:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3ca9d1b000/0x20c3e53e78bb1abc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1ab5 expref: 14 pid: 5789 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.199940:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947386.199971:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:3311:x1870604319856128:12345-0@lo:103: Request processed in 73us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947386.199977:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783947386.199990:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947386.199997:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:3311:x1870604319856256:12345-0@lo:103: 00010000:00010000:1.0:1783947386.200004:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947386.200008:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3ca9d1bc00/0x20c3e53e78bb1a4c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1a45 expref: 13 pid: 5790 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.200016:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3ca9d1bc00/0x20c3e53e78bb1a4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1a45 expref: 13 pid: 5790 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.200025:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947386.200051:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:3311:x1870604319856256:12345-0@lo:103: Request processed in 55us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947386.200058:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947386.200090:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319856256:0@lo:103: 00000100:00100000:1.0:1783947386.200096:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319856128:0@lo:103: 00010000:00010000:3.0:1783947386.200264:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947386.200356:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85634300 going to sleep for 11 seconds 00010000:00010000:2.0:1783947386.200381:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3ca9d1b000/0x20c3e53e78bb1abc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1ab5 expref: 12 pid: 5789 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947386.200393:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1870604319855744:0@lo:104: 00010000:00010000:2.0:1783947386.200403:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3ca9d1bc00/0x20c3e53e78bb1a4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1a45 expref: 11 pid: 5790 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947386.200410:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1870604319855872:0@lo:104: 00000100:00100000:1.0:1783947386.200608:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319856000 00000100:00100000:1.0:1783947386.200613:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319856000 00000100:00100000:1.0:1783947386.200638:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783947386.200645:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83376680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:5791:x1870604319856000:12345-0@lo:104: 00010000:00010000:1.0:1783947386.200654:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3c813d1c00/0x20c3e53e78bb1a29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1a30 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.200750:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947386.200783:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83376680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:5791:x1870604319856000:12345-0@lo:104: Request processed in 112us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947386.200791:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783947386.200847:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1870604319856000:0@lo:104: 00010000:00010000:2.0:1783947386.200869:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1b17 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.201056:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947386.201062:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3c813d1c00/0x20c3e53e78bb1a29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1a30 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.201069:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c813d1c00 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:3.0:1783947386.201072:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3c813d1c00/0x20c3e53e78bb1a29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1a30 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.201079:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3c813d1c00/0x20c3e53e78bb1a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1a30 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947386.201085:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3c813d1c00/0x20c3e53e78bb1a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1a30 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947386.201089:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783947386.201123:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3c813d1c00/0x20c3e53e78bb1a29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1a30 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.201129:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947386.201157:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3c813d1c00/0x20c3e53e78bb1a29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1a30 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.201163:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3c813d1c00/0x20c3e53e78bb1a29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1a30 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.201178:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947386.201180:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947386.201182:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947386.201221:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319856384:0@lo:103: 00000100:00100000:0.0:1783947386.201255:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947386.201323:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319856384 00000100:00100000:3.0:1783947386.201328:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319856384 00010000:00010000:3.0:1783947386.201354:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1a30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1a29 expref: 11 pid: 5789 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947386.201389:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783947386.201397:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83370000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:3313:x1870604319856384:12345-0@lo:103: 00010000:00010000:3.0:1783947386.201406:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947386.201410:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1a30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1a29 expref: 11 pid: 5789 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.201443:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1a30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1a29 expref: 11 pid: 5789 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.201456:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1a30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1a29 expref: 11 pid: 5789 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.201467:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1b17 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.201475:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1b17 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.201487:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1b17 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.201493:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1b17 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.201500:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1b17 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.201505:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1b17 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.201519:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1aa00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947386.201532:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1b17 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.201539:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1b17 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.201550:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1b17 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.201558:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947386.201587:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83370000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+10:3313:x1870604319856384:12345-0@lo:103: Request processed in 191us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947386.201592:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783947386.201617:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319856384:0@lo:103: 00010000:00010000:2.0:1783947386.201767:0:5791:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1b17 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.201775:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1b17 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.201781:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1b17 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783947386.201792:0:5791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1783947386.289276:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+9:6587:x1870604319855616:12345-0@lo:253: Request processed in 112207us (122204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947386.289293:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783947386.289481:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f53100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319855616:0@lo:253: 10000000:01000000:1.0:1783947386.289497:0:6587:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783947386.289501:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783947386.289502:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783947386.289504:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947386.289505:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1783947386.289506:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947386.289508:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947386.289509:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783947386.289511:0:6587:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783947386.289512:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947386.289514:0:6587:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783947386.289544:0:6587:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b3cb6183000 from lustre-OST0000 10000000:01000000:1.0:1783947386.289570:0:6587:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1783947386.289579:0:6587:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783947386.289586:0:6587:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8b3c85974d40 local copy 10000000:01000000:1.0:1783947386.289590:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783947386.289629:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.289640:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.289649:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947386.289667:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f53100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319856512:0@lo:101: 00000100:00100000:1.0:1783947386.289925:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947386.289971:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c88216d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947386.290159:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319856512 00000100:00100000:2.0:1783947386.290165:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319856512 00000100:00100000:2.0:1783947386.290211:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783947386.290221:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+9:6587:x1870604319856512:12345-0@lo:101: 00010000:00010000:2.0:1783947386.290234:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947386.290249:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1b25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1b1e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.290269:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1b1e expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.290280:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1b1e expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.290289:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1aa00, rc 0) 00000100:00100000:2.0:1783947386.290333:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+10:6587:x1870604319856512:12345-0@lo:101: Request processed in 114us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947386.290340:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783947386.290459:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f53100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319856512:0@lo:101: 00010000:00010000:0.0:1783947386.290474:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1b1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x20c3e53e78bb1b25 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.290483:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1b1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x20c3e53e78bb1b25 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947386.290621:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319856640:0@lo:501: 00000100:00100000:0.0:1783947386.290649:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947386.290666:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783947386.290870:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319856640 00000100:00100000:2.0:1783947386.290946:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319856640 00000100:00100000:2.0:1783947386.290983:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783947386.290991:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+10:6587:x1870604319856640:12345-0@lo:501: 00000100:00100000:2.0:1783947386.291204:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+10:6587:x1870604319856640:12345-0@lo:501: Request processed in 213us (553us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783947386.291211:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783947386.291249:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319856640:0@lo:501: 10000000:01000000:2.0:1783947386.291263:0:6587:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783947386.291292:0:6587:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783947386.291304:0:6587:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x20c3e53e78bb1b25 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.291312:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x20c3e53e78bb1b25 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.291319:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x20c3e53e78bb1b25 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.291336:0:6587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783947386.291356:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b3cb6183000 10000000:01000000:2.0:1783947386.291361:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783947386.291379:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8b3c85974d40 10000000:01000000:2.0:1783947386.291382:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1783947386.291386:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8b3c85974d40 from 1 10000000:01000000:2.0:1783947386.291388:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783947386.291410:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1bc00/0x20c3e53e78bb1b2c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.291443:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1bc00/0x20c3e53e78bb1b2c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.291452:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1bc00/0x20c3e53e78bb1b2c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947386.291464:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319856768:0@lo:101: 00000100:00100000:2.0:1783947386.291489:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947386.291507:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85634c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947386.291519:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319856768 00000100:00100000:2.0:1783947386.291629:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319856768 00010000:00010000:3.0:1783947386.291780:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947386.291786:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x20c3e53e78bb1b25 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.291794:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a000 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:3.0:1783947386.291797:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x20c3e53e78bb1b25 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.291805:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x20c3e53e78bb1b25 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947386.291811:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x20c3e53e78bb1b25 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947386.291827:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783947386.291845:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1b1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x20c3e53e78bb1b25 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.291851:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947386.291868:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1b1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x20c3e53e78bb1b25 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947386.292007:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783947386.292021:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+10:6587:x1870604319856768:12345-0@lo:101: 00010000:00010000:2.0:1783947386.292030:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947386.292042:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3ca9d1b000/0x20c3e53e78bb1b33 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1b2c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.292059:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3ca9d1b000/0x20c3e53e78bb1b33 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1b2c expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.292068:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3ca9d1b000/0x20c3e53e78bb1b33 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1b2c expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.292076:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1b000, rc 0) 00000100:00100000:2.0:1783947386.292110:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:6587:x1870604319856768:12345-0@lo:101: Request processed in 91us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947386.292116:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:3.0:1783947386.292151:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1b1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x20c3e53e78bb1b25 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.292169:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947386.292171:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947386.292173:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947386.292185:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319856896:0@lo:103: 00000100:00100000:3.0:1783947386.292213:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947386.292247:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319856896 00000100:00100000:3.0:1783947386.292251:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319856896 00000100:00100000:3.0:1783947386.292282:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947386.292289:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:3314:x1870604319856896:12345-0@lo:103: 00010000:00010000:3.0:1783947386.292298:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947386.292310:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1b25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20c3e53e78bb1b1e expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.292321:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947386.292347:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+10:3314:x1870604319856896:12345-0@lo:103: Request processed in 59us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947386.292354:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947386.292451:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319856896:0@lo:103: 00000100:00100000:2.0:1783947386.293102:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319856768:0@lo:101: 00010000:00010000:2.0:1783947386.293120:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1bc00/0x20c3e53e78bb1b2c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1b33 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.293130:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1bc00/0x20c3e53e78bb1b2c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1b33 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947386.293147:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783947386.293201:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1bc00/0x20c3e53e78bb1b2c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1b33 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.293209:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1bc00/0x20c3e53e78bb1b2c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1b33 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947386.293229:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783947386.293233:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783947386.293238:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1783947386.293241:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783947386.293262:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1b3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.293268:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1b3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.293275:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1b3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947386.293287:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319857024:0@lo:101: 00000100:00100000:2.0:1783947386.293320:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947386.293351:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85634c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947386.293438:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319857024 00000100:00100000:0.0:1783947386.293443:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319857024 00000100:00100000:0.0:1783947386.293481:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783947386.293488:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+10:6587:x1870604319857024:12345-0@lo:101: 00010000:00010000:0.0:1783947386.293498:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947386.293508:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c80031c00/0x20c3e53e78bb1b41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1b3a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.293661:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c80031c00/0x20c3e53e78bb1b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1b3a expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.293720:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c80031c00/0x20c3e53e78bb1b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1b3a expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.293728:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c80031c00, rc 0) 00000100:00100000:0.0:1783947386.293771:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:6587:x1870604319857024:12345-0@lo:101: Request processed in 284us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947386.293785:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783947386.293861:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319857024:0@lo:101: 00010000:00010000:2.0:1783947386.293872:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1b3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1b41 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.293959:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1b3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1b41 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947386.294047:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319857152:0@lo:501: 00000100:00100000:2.0:1783947386.294073:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947386.294133:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85634c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783947386.294225:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319857152 00000100:00100000:3.0:1783947386.294230:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319857152 00000100:00100000:3.0:1783947386.294295:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783947386.294303:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:6587:x1870604319857152:12345-0@lo:501: 00000100:00100000:3.0:1783947386.294563:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:6587:x1870604319857152:12345-0@lo:501: Request processed in 261us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947386.294570:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783947386.294638:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319857152:0@lo:501: 00000100:00100000:0.0:1783947386.294668:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83371880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319857280:0@lo:503: 00000100:00100000:0.0:1783947386.294845:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947386.295104:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947386.295182:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319857280 00000100:00100000:2.0:1783947386.295194:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319857280 00000100:00100000:2.0:1783947386.295220:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783947386.295227:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:6587:x1870604319857280:12345-0@lo:503: 00000100:00100000:2.0:1783947386.295389:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:6587:x1870604319857280:12345-0@lo:503: Request processed in 162us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947386.295397:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783947386.295502:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83371880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319857280:0@lo:503: 00000040:00080000:0.0:1783947386.296008:0:6587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783947386.296067:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83371880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319857408:0@lo:502: 00000100:00100000:0.0:1783947386.296107:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947386.296216:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947386.296289:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319857408 00000100:00100000:3.0:1783947386.296294:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319857408 00000100:00100000:1.0:1783947386.296343:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783947386.296353:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:6587:x1870604319857408:12345-0@lo:502: 00000100:00100000:1.0:1783947386.296743:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:6587:x1870604319857408:12345-0@lo:502: Request processed in 391us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947386.296751:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783947386.296990:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83371880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319857408:0@lo:502: 00000040:00080000:0.0:1783947386.297219:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783947386.297269:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1783947386.297302:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1783947386.297347:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1783947386.297398:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1783947386.297511:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1783947386.297610:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83371880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319857536:0@lo:502: 00000100:00100000:0.0:1783947386.297658:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947386.297791:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947386.298062:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319857536 00000100:00100000:1.0:1783947386.298069:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319857536 00000100:00100000:1.0:1783947386.298147:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783947386.298155:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:6587:x1870604319857536:12345-0@lo:502: 00000100:00100000:1.0:1783947386.298323:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:6587:x1870604319857536:12345-0@lo:502: Request processed in 168us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947386.298330:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783947386.298412:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83371880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319857536:0@lo:502: 00000040:00080000:0.0:1783947386.298548:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1783947386.298558:0:6587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1783947386.299261:0:6606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783947386.299270:0:6606:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1783947386.299276:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947386.299284:0:6606:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1783947386.299290:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783947386.299305:0:6606:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8b3cc18b3380) 00000020:00000080:0.0:1783947386.299327:0:6606:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783947386.299333:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783947386.299456:0:6606:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b3cb6183000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1783947386.299464:0:6606:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783947386.299471:0:6606:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x20c3e53e78bb1b4f 00010000:00010000:0.0:1783947386.304709:0:6606:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1783947386.305836:0:6606:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1783947386.308350:0:6606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1783947386.308802:0:6606:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1783947386.318751:0:6606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1783947386.319328:0:6606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1783947386.322118:0:6606:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1783947386.322130:0:6606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947386.322137:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947386.322139:0:6606:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1783947386.322144:0:6606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947386.322148:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947386.322150:0:6606:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783947386.322153:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783947386.322155:0:6606:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783947386.322207:0:6606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947386.322211:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947386.322213:0:6606:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783947386.322217:0:6606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1783947386.329622:0:6587:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1783947386.329666:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783947386.329810:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1b3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1b41 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.329824:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1b41 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947386.329834:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3cb6183000 from 1 10000000:01000000:0.0:1783947386.329836:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783947386.330386:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030c00/0x20c3e53e78bb1b56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.330397:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3c80030c00/0x20c3e53e78bb1b56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.330409:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3c80030c00/0x20c3e53e78bb1b56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947386.330463:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83371880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319857664:0@lo:101: 00000100:00100000:0.0:1783947386.330602:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947386.330648:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432f600 going to sleep for 11 seconds 00000100:00100000:3.0:1783947386.332658:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319857664 00000100:00100000:3.0:1783947386.332672:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319857664 00000100:00100000:3.0:1783947386.332730:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783947386.332739:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:6587:x1870604319857664:12345-0@lo:101: 00010000:00010000:3.0:1783947386.332757:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947386.332774:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1b5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1b56 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.332802:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1b5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1b56 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.332813:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1b5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1b56 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.332822:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147c200, rc 0) 00000100:00100000:3.0:1783947386.332901:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:6587:x1870604319857664:12345-0@lo:101: Request processed in 163us (2299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947386.332908:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783947386.333088:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83371880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319857664:0@lo:101: 00010000:00010000:0.0:1783947386.333103:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3c80030c00/0x20c3e53e78bb1b56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1b5d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.333113:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3c80030c00/0x20c3e53e78bb1b56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1b5d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947386.333221:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83371880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319857792:0@lo:501: 00000100:00100000:0.0:1783947386.333253:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947386.333291:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432f600 going to sleep for 11 seconds 00000100:00100000:3.0:1783947386.335001:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319857792 00000100:00100000:3.0:1783947386.335024:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319857792 00000100:00100000:3.0:1783947386.335069:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783947386.335078:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:6587:x1870604319857792:12345-0@lo:501: 00000100:00100000:3.0:1783947386.335336:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:6587:x1870604319857792:12345-0@lo:501: Request processed in 259us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947386.335343:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783947386.335866:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83371880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319857792:0@lo:501: 00000100:00100000:0.0:1783947386.335987:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83371880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319857920:0@lo:503: 00000100:00100000:0.0:1783947386.336031:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947386.336064:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432f600 going to sleep for 11 seconds 00000100:00100000:3.0:1783947386.336127:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319857920 00000100:00100000:3.0:1783947386.336132:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319857920 00000100:00100000:3.0:1783947386.336170:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783947386.336178:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:6587:x1870604319857920:12345-0@lo:503: 00000100:00100000:3.0:1783947386.336326:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:6587:x1870604319857920:12345-0@lo:503: Request processed in 149us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947386.336332:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783947386.336385:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83371880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319857920:0@lo:503: 00000040:00080000:3.0:1783947386.337134:0:6587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783947386.337199:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319858048:0@lo:502: 00000100:00100000:3.0:1783947386.337247:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947386.337283:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319858048 00000100:00100000:3.0:1783947386.337287:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319858048 00000100:00100000:3.0:1783947386.337318:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783947386.337325:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:6587:x1870604319858048:12345-0@lo:502: 00000100:00100000:2.0:1783947386.337659:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb61a7600 going to sleep for 11 seconds 00000100:00100000:3.0:1783947386.338770:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:6587:x1870604319858048:12345-0@lo:502: Request processed in 1437us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947386.338781:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783947386.341030:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319858048:0@lo:502: 00000040:00080000:2.0:1783947386.341377:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1783947386.341689:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1783947386.341731:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319858176:0@lo:502: 00000100:00100000:2.0:1783947386.341797:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947386.341939:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c856346c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947386.342016:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319858176 00000100:00100000:0.0:1783947386.342022:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319858176 00000100:00100000:0.0:1783947386.342107:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783947386.342116:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:6587:x1870604319858176:12345-0@lo:502: 00000100:00100000:0.0:1783947386.342290:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:6587:x1870604319858176:12345-0@lo:502: Request processed in 175us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947386.342297:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783947386.342375:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319858176:0@lo:502: 00000040:00080000:2.0:1783947386.342493:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1783947386.342503:0:6587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1783947386.343348:0:6610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947386.343357:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947386.343359:0:6610:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783947386.343376:0:6610:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b3cb6183000 00000020:00000080:2.0:1783947386.343379:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783947386.343397:0:6610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947386.343400:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947386.343401:0:6610:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783947386.343404:0:6610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1783947386.347076:0:6587:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783947386.347109:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947386.347183:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030c00/0x20c3e53e78bb1b56 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1b5d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.347195:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c80030c00/0x20c3e53e78bb1b56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1b5d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947386.347240:0:6587:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783947386.347242:0:6587:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b3cb6183000 10000000:01000000:1.0:1783947386.347246:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b3cb6183000 10000000:01000000:1.0:1783947386.347249:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783947386.347255:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b3cb6183000 from 1 10000000:01000000:1.0:1783947386.347257:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783947386.347290:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1b64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.347298:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1b64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.347309:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1b64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947386.347332:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319858304:0@lo:101: 00000100:00100000:1.0:1783947386.347403:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947386.347468:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c83610780 going to sleep for 11 seconds 00000100:00100000:3.0:1783947386.347702:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319858304 00000100:00100000:3.0:1783947386.347708:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319858304 00000100:00100000:3.0:1783947386.347760:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783947386.347777:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:6587:x1870604319858304:12345-0@lo:101: 00010000:00010000:3.0:1783947386.347789:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947386.347801:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1b6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1b64 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.347821:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1b64 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.347832:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1b64 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947386.347839:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147d000, rc 0) 00000100:00100000:1.0:1783947386.348799:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319858304:0@lo:101: 00010000:00010000:1.0:1783947386.348819:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1b64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1b6b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.348829:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1b64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1b6b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947386.348973:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319858432:0@lo:501: 00000100:00100000:1.0:1783947386.349013:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947386.349052:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c83610780 going to sleep for 11 seconds 00000100:00100000:0.0:1783947386.349180:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319858432 00000100:00100000:0.0:1783947386.349186:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319858432 00000100:00100000:0.0:1783947386.349230:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783947386.349237:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:6587:x1870604319858432:12345-0@lo:501: 00000100:00100000:0.0:1783947386.349506:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:6587:x1870604319858432:12345-0@lo:501: Request processed in 268us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947386.349513:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783947386.349828:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:6587:x1870604319858304:12345-0@lo:101: Request processed in 101us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947386.349835:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783947386.350009:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319858432:0@lo:501: 00000100:00100000:1.0:1783947386.350041:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319858560:0@lo:503: 00000100:00100000:1.0:1783947386.350081:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947386.350113:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c83610780 going to sleep for 11 seconds 00000100:00100000:0.0:1783947386.350157:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319858560 00000100:00100000:0.0:1783947386.350163:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319858560 00000100:00100000:0.0:1783947386.350237:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783947386.350244:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:6587:x1870604319858560:12345-0@lo:503: 00000100:00100000:0.0:1783947386.350410:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:6587:x1870604319858560:12345-0@lo:503: Request processed in 167us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947386.350443:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783947386.350554:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319858560:0@lo:503: 00000040:00080000:1.0:1783947386.350803:0:6587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783947386.350887:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319858688:0@lo:502: 00000100:00100000:1.0:1783947386.350921:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947386.351740:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c83610780 going to sleep for 11 seconds 00000100:00100000:3.0:1783947386.351813:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319858688 00000100:00100000:3.0:1783947386.351820:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319858688 00000100:00100000:3.0:1783947386.351855:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783947386.351863:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:6587:x1870604319858688:12345-0@lo:502: 00000100:00100000:3.0:1783947386.352210:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:6587:x1870604319858688:12345-0@lo:502: Request processed in 346us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947386.352218:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783947386.354060:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319858688:0@lo:502: 00000040:00080000:0.0:1783947386.359209:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1783947386.359284:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1783947386.359316:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1783947386.359355:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1783947386.359400:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1783947386.359473:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1783947386.359506:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1783947386.359996:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1783947386.360050:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1783947386.360081:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1783947386.360110:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1783947386.360168:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1783947386.360202:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1783947386.360231:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1783947386.360274:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1783947386.360306:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1783947386.360336:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1783947386.360394:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1783947386.360460:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1783947386.360495:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1783947386.361013:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1783947386.361056:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1783947386.361092:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1783947386.361158:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1783947386.361193:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1783947386.361226:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1783947386.361271:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1783947386.361305:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1783947386.361351:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83370e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319858816:0@lo:502: 00000100:00100000:0.0:1783947386.361770:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947386.362089:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947386.362249:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319858816 00000100:00100000:3.0:1783947386.362256:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319858816 00000100:00100000:3.0:1783947386.362336:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783947386.362346:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:6587:x1870604319858816:12345-0@lo:502: 00000100:00100000:3.0:1783947386.362636:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:6587:x1870604319858816:12345-0@lo:502: Request processed in 290us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947386.362652:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783947386.362743:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83370e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319858816:0@lo:502: 00000040:00080000:1.0:1783947386.362833:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1783947386.362845:0:6587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1783947386.364601:0:6611:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1783947386.364636:0:6611:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8b3b84a899c0) 00000020:00000080:1.0:1783947386.364657:0:6611:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1783947386.364821:0:6611:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b3cb6183000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783947386.364826:0:6611:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b3cb6183000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783947386.364829:0:6611:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b3cb6183000 3 00010000:00080000:1.0:1783947386.364859:0:6611:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b3b84a7c000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.132@tcp at head 00010000:00010000:1.0:1783947386.370216:0:6611:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1783947386.370311:0:6611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1783947386.370349:0:6611:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783947386.370361:0:6611:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x20c3e53e78bb1b79 00000100:00080000:1.0:1783947386.370383:0:6611:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783947386.370389:0:6611:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b3b84a7c000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1783947386.371678:0:6611:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3c84f51880 x1870604319858944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783947386.371742:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1870604319858944:0@lo:38: 00000100:00100000:0.0:1783947386.371809:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947386.371940:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319858944 00000100:00100000:2.0:1783947386.371946:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319858944 00000100:00100000:2.0:1783947386.371982:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783947386.371989:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1870604319858944:12345-0@lo:38: 00010000:00080000:2.0:1783947386.372011:0:5798:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:2.0:1783947386.372042:0:5798:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x20c3e53e78bb1b80 00000004:00100000:2.0:1783947386.372054:0:5798:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783947386.372082:0:5798:0:(import.c:65:import_set_state_nolock()) ffff8b3cb6187800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1783947386.375507:0:6611:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783947386.375599:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319859072:0@lo:400: 00000100:00100000:1.0:1783947386.375660:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947386.375722:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1783947386.375730:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1783947386.375940:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319859072 00000100:00100000:1.0:1783947386.375948:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319859072 00000100:00100000:1.0:1783947386.375986:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1783947386.375995:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783947386.376003:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319859072:12345-0@lo:400: 00000100:00100000:1.0:1783947386.376056:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319859072:12345-0@lo:400: Request processed in 53us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947386.376063:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783947386.376100:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b3c84f50e00 x1870604319859072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947386.376114:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319859072:0@lo:400: 00000040:00080000:1.0:1783947386.377267:0:6611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:2.0:1783947386.379760:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1870604319858944:12345-0@lo:38: Request processed in 7762us (7943us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947386.379774:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:2.0:1783947386.379814:0:6587:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1783947386.379840:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783947386.379863:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1b64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1b6b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947386.380616:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1b64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1b6b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783947386.380694:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783947386.380696:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783947386.380698:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947386.380699:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947386.380700:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947386.380702:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947386.380703:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947386.380704:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783947386.380706:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783947386.380707:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947386.380709:0:6587:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783947386.380712:0:6587:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1783947386.380715:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783947386.380716:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783947386.380717:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947386.380718:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947386.380719:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947386.380721:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947386.380722:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947386.380722:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783947386.380724:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783947386.380725:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947386.380726:0:6587:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783947386.380751:0:6587:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783947386.380769:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319859200:0@lo:253: 00000100:00100000:2.0:1783947386.380964:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947386.381011:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c856346c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947386.382542:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319859200 00000100:00100000:3.0:1783947386.382556:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319859200 00000100:00100000:3.0:1783947386.382620:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783947386.382630:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:6587:x1870604319859200:12345-0@lo:253: 20000000:01000000:3.0:1783947386.382660:0:5791:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783947386.382673:0:5791:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1783947386.389148:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b3c84f51880 x1870604319858944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947386.389164:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783947386.389176:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1783947386.389184:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783947386.389190:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783947386.389194:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3b84a7c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783947386.389202:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1870604319858944:0@lo:38: 20000000:01000000:0.0:1783947386.436015:0:5791:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783947386.436026:0:5791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783947386.436044:0:5812:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783947386.436047:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783947386.436069:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b3c80030400/0x20c3e53e78bb1b87 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.436087:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3c813d0000/0x20c3e53e78bb1ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1adf expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.436109:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b3c80030400/0x20c3e53e78bb1b87 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.436146:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3c813d0000/0x20c3e53e78bb1ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1adf expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.436161:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3c813d0000/0x20c3e53e78bb1ae6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1adf expref: 13 pid: 5789 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947386.436175:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83372300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1870604319859328:0@lo:104: 00000100:00100000:0.0:1783947386.436236:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947386.436286:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432f000 going to sleep for 11 seconds 00000100:00100000:0.0:1783947386.436304:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319859328 00000100:00100000:0.0:1783947386.436311:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319859328 00000100:00100000:0.0:1783947386.436352:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947386.436361:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83371c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:5812:x1870604319859328:12345-0@lo:104: 00010000:00010000:0.0:1783947386.436385:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3c813d1a00/0x20c3e53e78bb1adf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1ae6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.436463:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783947386.436469:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83371c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:5812:x1870604319859328:12345-0@lo:104: Request processed in 109us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947386.436476:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947386.436518:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83372300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1870604319859328:0@lo:104: 00010000:00010000:0.0:1783947386.436548:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b3c80030400/0x20c3e53e78bb1b87 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.436564:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947386.436575:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3c813d1a00/0x20c3e53e78bb1adf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1ae6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.436582:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c813d1a00 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:0.0:1783947386.436585:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3c813d1a00/0x20c3e53e78bb1adf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1ae6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.436593:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3c813d1a00/0x20c3e53e78bb1adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1ae6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947386.436601:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3c813d1a00/0x20c3e53e78bb1adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1ae6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947386.436607:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783947386.436633:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3c813d1a00/0x20c3e53e78bb1adf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1ae6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.436639:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783947386.436655:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3c813d1a00/0x20c3e53e78bb1adf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1ae6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.436662:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3c813d1a00/0x20c3e53e78bb1adf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1ae6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.436678:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947386.436680:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947386.436682:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947386.436699:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319859456:0@lo:103: 00000100:00100000:0.0:1783947386.436730:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947386.436773:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319859456 00000100:00100000:0.0:1783947386.436777:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319859456 00010000:00010000:0.0:1783947386.436799:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3c813d0000/0x20c3e53e78bb1ae6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1adf expref: 14 pid: 5789 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947386.436823:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947386.436829:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c856ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:3312:x1870604319859456:12345-0@lo:103: 00010000:00010000:0.0:1783947386.436839:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947386.436843:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3c813d0000/0x20c3e53e78bb1ae6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1adf expref: 14 pid: 5789 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.436853:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3c813d0000/0x20c3e53e78bb1ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1adf expref: 14 pid: 5789 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.436866:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c813d0000/0x20c3e53e78bb1ae6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1adf expref: 14 pid: 5789 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.436878:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b3c80030400/0x20c3e53e78bb1b87 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.436886:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c80030400/0x20c3e53e78bb1b87 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783947386.436898:0:5783:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000920105s 00010000:00010000:0.0:1783947386.437183:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3c80030400/0x20c3e53e78bb1b87 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.437191:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3c80030400/0x20c3e53e78bb1b87 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.437197:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b3c80030400/0x20c3e53e78bb1b87 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.437203:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b3c80030400/0x20c3e53e78bb1b87 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.437213:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c80030400 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947386.437217:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b3c80030400/0x20c3e53e78bb1b87 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.437224:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b3c80030400/0x20c3e53e78bb1b87 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.437829:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b3c80030400/0x20c3e53e78bb1b87 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947386.437840:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b3c80030400/0x20c3e53e78bb1b87 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.437949:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b3c80030400/0x20c3e53e78bb1b87 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.437959:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c80030400/0x20c3e53e78bb1b87 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947386.437974:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947386.438033:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c856ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:3312:x1870604319859456:12345-0@lo:103: Request processed in 1202us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947386.438042:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783947386.438237:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319859456:0@lo:103: 00000100:00100000:0.0:1783947386.449340:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:6587:x1870604319859200:12345-0@lo:253: Request processed in 66701us (68365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947386.449356:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783947386.449590:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6587:1870604319859200:0@lo:253: 10000000:01000000:3.0:1783947386.449605:0:6587:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783947386.449609:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783947386.449610:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783947386.449611:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783947386.449612:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947386.449613:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947386.449615:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947386.449616:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783947386.449617:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783947386.449619:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783947386.449620:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947386.449622:0:6587:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783947386.449637:0:6587:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783947386.455733:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1783947386.456047:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1783947386.456306:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1783947386.456611:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1783947386.456798:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1783947386.462042:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1783947386.466059:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1783947386.721672:0:6587:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1783947386.721680:0:6587:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1783947386.721721:0:6587:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783947386.721780:0:6587:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.132@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783947386.721796:0:6587:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783947386.721826:0:6587:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1783947387.193792:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947388.220290:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947389.241974:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783947389.497564:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783947389.497570:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b3c85ce6800 from 21 10000000:01000000:0.0:1783947389.497582:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783947389.497634:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030400/0x20c3e53e78bb1b8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947389.497646:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3c80030400/0x20c3e53e78bb1b8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947389.497791:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3c80030400/0x20c3e53e78bb1b8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947389.497818:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83370000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319859584:0@lo:101: 00000100:00100000:0.0:1783947389.497882:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947389.497991:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432f540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947389.501788:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319859584 00000100:00100000:1.0:1783947389.501803:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319859584 00000100:00100000:1.0:1783947389.501908:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783947389.501919:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5793:x1870604319859584:12345-0@lo:101: 00010000:00010000:1.0:1783947389.501935:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947389.501952:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cad73a000/0x20c3e53e78bb1b95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1b8e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947389.501979:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cad73a000/0x20c3e53e78bb1b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1b8e expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947389.501991:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cad73a000/0x20c3e53e78bb1b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1b8e expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947389.502001:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a000, rc 0) 00000100:00100000:1.0:1783947389.502077:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:5793:x1870604319859584:12345-0@lo:101: Request processed in 161us (4193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947389.502084:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783947389.505542:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83370000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319859584:0@lo:101: 00010000:00010000:0.0:1783947389.505570:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3c80030400/0x20c3e53e78bb1b8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1b95 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947389.505583:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3c80030400/0x20c3e53e78bb1b8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1b95 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947389.505681:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83370000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319859712:0@lo:501: 00000100:00100000:0.0:1783947389.505739:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947389.505783:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432f540 going to sleep for 11 seconds 00000100:00100000:2.0:1783947389.506026:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319859712 00000100:00100000:2.0:1783947389.506033:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319859712 00000100:00100000:2.0:1783947389.506082:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783947389.506092:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:5793:x1870604319859712:12345-0@lo:501: 00000100:00100000:2.0:1783947389.506837:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:5793:x1870604319859712:12345-0@lo:501: Request processed in 741us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947389.506847:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783947389.507185:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83370000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319859712:0@lo:501: 00000100:00100000:3.0:1783947389.507229:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319859840:0@lo:503: 00000100:00100000:3.0:1783947389.507285:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947389.507314:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319859840 00000100:00100000:3.0:1783947389.507317:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c833b9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947389.507319:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319859840 00000100:00100000:2.0:1783947389.507355:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783947389.507363:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:5793:x1870604319859840:12345-0@lo:503: 00000100:00100000:2.0:1783947389.509956:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:5793:x1870604319859840:12345-0@lo:503: Request processed in 2584us (2661us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947389.509973:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783947389.510189:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319859840:0@lo:503: 00000100:00100000:1.0:1783947389.511188:0:6740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6740:1870604319859968:0@lo:502: 00000100:00100000:1.0:1783947389.511247:0:6740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947389.511286:0:6740:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb63d40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947389.511329:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319859968 00000100:00100000:0.0:1783947389.511336:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319859968 00000100:00100000:0.0:1783947389.511390:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783947389.511399:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:6740:x1870604319859968:12345-0@lo:502: 00000100:00100000:0.0:1783947389.511941:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:6740:x1870604319859968:12345-0@lo:502: Request processed in 541us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947389.511959:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783947389.512129:0:6740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6740:1870604319859968:0@lo:502: 00000100:00100000:2.0:1783947389.512181:0:6740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6740:1870604319860096:0@lo:502: 00000100:00100000:2.0:1783947389.512215:0:6740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947389.512250:0:6740:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e2b600 going to sleep for 11 seconds 00000100:00100000:0.0:1783947389.512292:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319860096 00000100:00100000:0.0:1783947389.512297:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319860096 00000100:00100000:0.0:1783947389.512330:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783947389.512337:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:6740:x1870604319860096:12345-0@lo:502: 00000100:00100000:0.0:1783947389.512838:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:6740:x1870604319860096:12345-0@lo:502: Request processed in 500us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947389.512846:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783947389.512950:0:6740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6740:1870604319860096:0@lo:502: 00000040:00080000:2.0:1783947389.512972:0:6740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1783947389.513147:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1783947389.513168:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783947389.513178:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030400/0x20c3e53e78bb1b8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1b95 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947389.513189:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c80030400/0x20c3e53e78bb1b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1b95 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947389.513198:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783947389.513200:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8b3c85ce6800 from 4 10000000:01000000:0.0:1783947389.513203:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783947389.513231:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1b9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947389.513238:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1b9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947389.513248:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1b9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947389.513262:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83370380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319860224:0@lo:101: 00000100:00100000:0.0:1783947389.513298:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947389.513332:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947389.513383:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319860224 00000100:00100000:2.0:1783947389.513389:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319860224 00000100:00100000:2.0:1783947389.513472:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783947389.513481:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:5793:x1870604319860224:12345-0@lo:101: 00010000:00010000:2.0:1783947389.513492:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947389.513516:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1ba3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1b9c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947389.513536:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1b9c expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947389.513545:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1b9c expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947389.513554:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a600, rc 0) 00000100:00100000:2.0:1783947389.513590:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:5793:x1870604319860224:12345-0@lo:101: Request processed in 111us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947389.513596:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783947389.513923:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83370380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319860224:0@lo:101: 00010000:00010000:0.0:1783947389.513938:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1b9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1ba3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947389.513946:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1b9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1ba3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947389.513995:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83370380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319860352:0@lo:256: 00000100:00100000:0.0:1783947389.514036:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947389.514066:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947389.515141:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319860352 00000100:00100000:2.0:1783947389.515151:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319860352 00000100:00100000:2.0:1783947389.515201:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783947389.515210:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:5793:x1870604319860352:12345-0@lo:256: 20000000:01000000:2.0:1783947389.515233:0:5791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783947389.515249:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783947389.515252:0:5791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1783947389.515373:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:5793:x1870604319860352:12345-0@lo:256: Request processed in 164us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947389.515381:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783947389.515489:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83370380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319860352:0@lo:256: 10000000:01000000:0.0:1783947389.515561:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783947389.515570:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1b9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1ba3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947389.515579:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1b9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1ba3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947389.515588:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783947389.515591:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1783947389.515593:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783947389.515631:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947389.515638:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947389.515991:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947389.516010:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83370380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319860480:0@lo:101: 00000100:00100000:0.0:1783947389.516047:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947389.516083:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947389.516523:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319860480 00000100:00100000:3.0:1783947389.516530:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319860480 00000100:00100000:3.0:1783947389.516569:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783947389.516577:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:5793:x1870604319860480:12345-0@lo:101: 00010000:00010000:3.0:1783947389.516590:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947389.516603:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1bb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1baa expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947389.516625:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1baa expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947389.516635:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1baa expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947389.516645:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147d600, rc 0) 00000100:00100000:3.0:1783947389.516688:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:5793:x1870604319860480:12345-0@lo:101: Request processed in 112us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947389.516695:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783947389.517805:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83370380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319860480:0@lo:101: 00010000:00010000:1.0:1783947389.517826:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1baa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1bb1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947389.517844:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1baa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1bb1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947389.517912:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319860608:0@lo:501: 00000100:00100000:1.0:1783947389.517952:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947389.517981:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb63d40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947389.518384:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319860608 00000100:00100000:0.0:1783947389.518391:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319860608 00000100:00100000:0.0:1783947389.518464:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783947389.518545:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:5793:x1870604319860608:12345-0@lo:501: 00000100:00100000:0.0:1783947389.518904:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:5793:x1870604319860608:12345-0@lo:501: Request processed in 432us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947389.519008:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319860608:0@lo:501: 00000100:00100000:1.0:1783947389.519042:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319860736:0@lo:503: 00000100:00100000:1.0:1783947389.519081:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947389.519100:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb63d40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947389.525873:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319860736 00000100:00100000:1.0:1783947389.525889:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319860736 00000100:00100000:0.0:1783947389.531096:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783947389.538864:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783947389.538883:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:5793:x1870604319860736:12345-0@lo:503: 00000100:00100000:1.0:1783947389.539318:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:5793:x1870604319860736:12345-0@lo:503: Request processed in 441us (20235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947389.539328:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783947389.539451:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319860736:0@lo:503: 00000100:00100000:1.0:1783947389.539851:0:6744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6744:1870604319860864:0@lo:502: 00000100:00100000:1.0:1783947389.539897:0:6744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947389.539925:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319860864 00000100:00100000:1.0:1783947389.539931:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319860864 00000100:00100000:1.0:1783947389.539958:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783947389.539965:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:6744:x1870604319860864:12345-0@lo:502: 00000100:00100000:1.0:1783947389.540183:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:6744:x1870604319860864:12345-0@lo:502: Request processed in 218us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947389.540190:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783947389.540235:0:6744:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb63d4600 going to sleep for 11 seconds 00000100:00100000:1.0:1783947389.540250:0:6744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6744:1870604319860864:0@lo:502: 00000020:01000000:1.0:1783947389.540271:0:6744:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783947389.540278:0:6744:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1783947389.540285:0:6744:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947389.540287:0:6744:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783947389.540292:0:6744:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783947389.540296:0:6744:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.132@tcp to nid 0x20000c0a8cb84 (192.168.203.132@tcp) 00000020:01000000:1.0:1783947389.540316:0:6744:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783947389.540318:0:6744:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783947389.540333:0:6744:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8b3b84a8cd40) 00000020:00000080:1.0:1783947389.540366:0:6744:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1783947389.540372:0:6744:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783947389.540485:0:6744:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1783947389.540491:0:6744:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783947389.540571:0:6744:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20c3e53e78bb1bbf 00010000:00080000:1.0:1783947389.540601:0:6744:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b3ca035e000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:1.0:1783947389.540912:0:6744:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1783947389.626464:0:6744:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1783947389.626485:0:6744:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783947389.628244:0:6744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947389.628448:0:6744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947389.628939:0:6744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1783947389.629014:0:6744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1783947389.631947:0:6747:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783947389.631955:0:6747:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783947389.637883:0:6744:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783947389.637897:0:6744:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783947389.637935:0:6744:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783947389.637955:0:6744:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20c3e53e78bb1bc6 00000100:00080000:2.0:1783947389.637966:0:6744:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783947389.637971:0:6744:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8b3ca035e000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1783947389.638004:0:6744:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3c83374700 x1870604319860992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783947389.638027:0:6744:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783947389.638083:0:6744:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947389.638087:0:6744:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947389.638089:0:6744:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783947389.638092:0:6744:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947389.638095:0:6744:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947389.638097:0:6744:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783947389.638100:0:6744:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783947389.638107:0:6744:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783947389.638138:0:6744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6744:1870604319861120:0@lo:502: 00000100:00100000:2.0:1783947389.638213:0:6744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947389.638260:0:6744:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e2bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947389.638460:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319861120 00000100:00100000:1.0:1783947389.638467:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319861120 00000100:00100000:1.0:1783947389.638518:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783947389.638527:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:6744:x1870604319861120:12345-0@lo:502: 00000100:00100000:1.0:1783947389.638771:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:6744:x1870604319861120:12345-0@lo:502: Request processed in 244us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947389.638778:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783947389.638878:0:6744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:6744:1870604319861120:0@lo:502: 00000020:01000000:1.0:1783947389.638901:0:6744:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947389.638905:0:6744:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947389.638907:0:6744:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783947389.638910:0:6744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1783947389.638972:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1783947389.638987:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783947389.638997:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1baa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1bb1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947389.639006:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1bb1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947389.639015:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783947389.639018:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8b3c85974d40 from 1 10000000:01000000:1.0:1783947389.639021:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783947389.639044:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ba00/0x20c3e53e78bb1bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947389.639052:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ba00/0x20c3e53e78bb1bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947389.639062:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ba00/0x20c3e53e78bb1bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947389.639074:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319861504:0@lo:101: 00000100:00100000:1.0:1783947389.639103:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947389.639124:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c88216240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947389.639390:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319861504 00000100:00100000:2.0:1783947389.639395:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319861504 00000100:00100000:2.0:1783947389.639441:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783947389.639449:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:5793:x1870604319861504:12345-0@lo:101: 00010000:00010000:2.0:1783947389.639460:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947389.639472:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1bd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1bcd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947389.639944:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1bcd expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947389.639960:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1bcd expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947389.639969:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1ae00, rc 0) 00000100:00100000:2.0:1783947389.640021:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:5793:x1870604319861504:12345-0@lo:101: Request processed in 572us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947389.640028:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783947389.640116:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319860992:0@lo:8: 00000100:00100000:0.0:1783947389.640154:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947389.640231:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319860992 00000100:00100000:2.0:1783947389.640236:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319860992 00000100:00100000:2.0:1783947389.640263:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947389.640268:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1870604319860992:12345-0@lo:8: 00010000:00080000:2.0:1783947389.640288:0:6590:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:2.0:1783947389.640313:0:6590:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20c3e53e78bb1bdb 00002000:00100000:2.0:1783947389.640356:0:6590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8b3b84a7d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783947389.640371:0:6590:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1783947389.640375:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1783947389.640767:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319861504:0@lo:101: 00010000:00010000:1.0:1783947389.640783:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ba00/0x20c3e53e78bb1bcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1bd4 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947389.640801:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ba00/0x20c3e53e78bb1bcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1bd4 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947389.640859:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319861632:0@lo:501: 00000100:00100000:1.0:1783947389.640890:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:2.0:1783947389.640944:0:6590:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783947389.641110:0:6590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783947389.641135:0:6590:0:(import.c:65:import_set_state_nolock()) ffff8b3b84a7e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947389.641180:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1870604319860992:12345-0@lo:8: Request processed in 910us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947389.641188:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947389.642511:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c88216240 going to sleep for 11 seconds 00000100:00100000:3.0:1783947389.642678:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319861248:0@lo:400: 00000100:00100000:3.0:1783947389.642732:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947389.642769:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947389.642775:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319861376:0@lo:400: 00000100:00100000:3.0:1783947389.642797:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947389.642839:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319861248 00000100:00100000:3.0:1783947389.642845:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319861248 00000100:00100000:3.0:1783947389.642880:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319861376 00000100:00100000:3.0:1783947389.642881:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319861376 00000100:00100000:3.0:1783947389.642925:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783947389.642931:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319861248:12345-0@lo:400: 00000100:00100000:3.0:1783947389.642974:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319861248:12345-0@lo:400: Request processed in 43us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947389.642980:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783947389.642993:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783947389.642997:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319861376:12345-0@lo:400: 00000100:00100000:3.0:1783947389.643017:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319861376:12345-0@lo:400: Request processed in 19us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947389.643022:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1783947389.643055:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3c84f51180 x1870604319861376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947389.643068:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319861376:0@lo:400: 00010000:00080000:3.0:1783947389.643077:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3c84f50380 x1870604319861248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947389.643084:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319861248:0@lo:400: 00000100:00080000:2.0:1783947389.643266:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783947389.643507:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3c83374700 x1870604319860992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783947399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947389.643517:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783947389.643526:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783947389.643534:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783947389.643539:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783947389.643542:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3ca035e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783947389.643558:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783947389.643563:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319860992:0@lo:8: 00000004:00080000:3.0:1783947389.643920:0:6747:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783947389.644013:0:6747:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 204914594475ns, next at 0ns, rc = 0 00000100:00100000:0.0:1783947389.650611:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319861632 00000100:00100000:0.0:1783947389.650630:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319861632 00000100:00100000:0.0:1783947389.655513:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783947389.655529:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:5793:x1870604319861632:12345-0@lo:501: 00000100:00100000:0.0:1783947389.655808:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:5793:x1870604319861632:12345-0@lo:501: Request processed in 283us (14916us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783947389.655816:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783947389.655862:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319861632:0@lo:501: 10000000:01000000:0.0:1783947389.655897:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783947389.655908:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ba00/0x20c3e53e78bb1bcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1bd4 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947389.655919:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ba00/0x20c3e53e78bb1bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1bd4 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783947389.700871:0:6748:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000004:00080000:1.0:1783947389.700879:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1783947389.700907:0:6748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83370a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6748:1870604319861888:0@lo:7: 00000100:00100000:3.0:1783947389.700936:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947389.700951:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319861760:0@lo:13: 00000100:00100000:0.0:1783947389.700967:0:6748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947389.701064:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319861888 00000100:00100000:1.0:1783947389.701071:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319861888 00000100:00100000:1.0:1783947389.701316:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947389.701325:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6748:x1870604319861888:12345-0@lo:7: 00000100:00080000:2.0:1783947389.703270:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947389.709882:0:6748:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432f540 going to sleep for 11 seconds 00002000:00080000:1.0:1783947389.719647:0:6592:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1783947389.719657:0:6592:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1783947389.720032:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947389.720234:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6748:x1870604319861888:12345-0@lo:7: Request processed in 18908us (19265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947389.720245:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783947389.720362:0:6748:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3c83370a80 x1870604319861888/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783947405 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947389.720379:0:6748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83370a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6748:1870604319861888:0@lo:7: 00000004:00080000:0.0:1783947389.720394:0:6748:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1783947389.720453:0:6748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83370a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6748:1870604319862016:0@lo:5: 00000100:00100000:0.0:1783947389.720490:0:6748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947389.720518:0:6748:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432f540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947389.721643:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319862016 00000100:00100000:1.0:1783947389.721743:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319862016 00000100:00100000:1.0:1783947389.721809:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783947389.721818:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6748:x1870604319862016:12345-0@lo:5: 00002000:00080000:1.0:1783947389.721846:0:6590:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1783947389.721849:0:6590:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1783947389.722187:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6748:x1870604319862016:12345-0@lo:5: Request processed in 370us (1695us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783947389.722196:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783947389.722243:0:6748:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3c83370a80 x1870604319862016/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783947405 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947389.722259:0:6748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83370a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6748:1870604319862016:0@lo:5: 00000004:00080000:1.0:1783947389.722271:0:6748:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1783947389.723823:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319861760 00000100:00100000:2.0:1783947389.723837:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319861760 00000100:00100000:2.0:1783947389.723883:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947389.723892:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1870604319861760:12345-0@lo:13: 00002000:00000024:2.0:1783947389.723923:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1783947389.723993:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1870604319861760:12345-0@lo:13: Request processed in 102us (3964us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947389.724000:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783947389.724243:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3c83370700 x1870604319861760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947389.724263:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319861760:0@lo:13: 00010000:00010000:0.0:1783947390.266305:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947391.290579:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783947392.193008:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1783947392.193031:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1783947392.317267:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947393.339348:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783947394.140544:0:6962:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783947394.362021:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947395.129842:0:6748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83372300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6748:1870604319862272:0@lo:700: 00000100:00100000:0.0:1783947395.129904:0:6748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947395.129948:0:6748:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c88216000 going to sleep for 11 seconds 00000100:00100000:0.0:1783947395.129964:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947395.129976:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319862144:0@lo:13: 00000100:00100000:0.0:1783947395.130001:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947395.130038:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319862272 00000100:00100000:0.0:1783947395.130045:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319862272 00000100:00100000:0.0:1783947395.130102:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783947395.130111:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6748:x1870604319862272:12345-0@lo:700: 00000100:00100000:0.0:1783947395.130144:0:6598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6598:1870604319862400:0@lo:700: 00000100:00100000:0.0:1783947395.130172:0:6598:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947395.130187:0:6598:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c88216cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947395.130216:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319862144 00000100:00100000:0.0:1783947395.130221:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319862144 00000100:00100000:0.0:1783947395.130265:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947395.130271:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1870604319862144:12345-0@lo:13: 00002000:00000024:0.0:1783947395.130294:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947395.130348:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1870604319862144:12345-0@lo:13: Request processed in 77us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947395.130355:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1783947395.130384:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783947395.130415:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3c83370700 x1870604319862144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947395.130453:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1783947395.131117:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319862144:0@lo:13: 00000100:00100000:2.0:1783947395.131328:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319862400 00000100:00100000:2.0:1783947395.131334:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319862400 00000100:00100000:2.0:1783947395.131411:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947395.131439:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6598:x1870604319862400:12345-0@lo:700: 00000100:00080000:0.0:1783947395.133085:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947395.136862:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319862528:0@lo:400: 00000100:00100000:1.0:1783947395.136943:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947395.136995:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947395.137004:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83370a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319862656:0@lo:400: 00000100:00100000:1.0:1783947395.137031:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947395.137349:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319862528 00000100:00100000:0.0:1783947395.137357:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319862528 00000100:00100000:0.0:1783947395.137400:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783947395.137410:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:3313:x1870604319862528:12345-0@lo:400: 00000100:00100000:0.0:1783947395.137502:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:3313:x1870604319862528:12345-0@lo:400: Request processed in 94us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947395.137509:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783947395.137956:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319862656 00000100:00100000:3.0:1783947395.137962:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319862656 00000100:00100000:3.0:1783947395.138016:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783947395.138025:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319862656:12345-0@lo:400: 00000100:00100000:3.0:1783947395.138070:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319862656:12345-0@lo:400: Request processed in 46us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947395.138082:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1783947395.138319:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3c83370a80 x1870604319862656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947395.138334:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83370a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319862656:0@lo:400: 00000100:00100000:1.0:1783947395.138346:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319862528:0@lo:400: 40000000:02000000:0.0:1783947395.201854:0:5803:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1783947395.209452:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6598:x1870604319862400:12345-0@lo:700: Request processed in 78025us (79270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947395.209482:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783947395.209665:0:6598:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3c83373100 x1870604319862400/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783947411 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947395.209683:0:6598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6598:1870604319862400:0@lo:700: 40000000:02000000:0.0:1783947395.209697:0:6598:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1783947395.299085:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6748:x1870604319862272:12345-0@lo:700: Request processed in 168967us (169172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947395.299115:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783947395.301788:0:6748:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3c83372300 x1870604319862272/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783947411 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947395.301808:0:6748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83372300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6748:1870604319862272:0@lo:700: 00010000:00010000:3.0:1783947395.385693:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:1.0:1783947395.393817:0:6748:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1783947395.413951:0:6748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83376a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6748:1870604319862784:0@lo:5: 00000100:00100000:2.0:1783947395.414025:0:6748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947395.414084:0:6748:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85d33300 going to sleep for 11 seconds 00000100:00100000:1.0:1783947395.416371:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319862784 00000100:00100000:1.0:1783947395.416383:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319862784 00000100:00100000:1.0:1783947395.416489:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947395.416501:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6748:x1870604319862784:12345-0@lo:5: 00002000:00080000:0.0:1783947395.451877:0:6591:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1783947395.451898:0:6591:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1783947395.463766:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6748:x1870604319862784:12345-0@lo:5: Request processed in 47256us (49728us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783947395.463788:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783947395.464916:0:6748:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3c83376a00 x1870604319862784/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783947411 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947395.464935:0:6748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83376a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6748:1870604319862784:0@lo:5: 00000004:00080000:2.0:1783947395.464950:0:6748:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1783947396.413651:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947397.434248:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947398.471002:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947399.485887:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783947399.534694:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:0.0:1783947400.249706:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319862912:0@lo:400: 00000100:00100000:0.0:1783947400.249781:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947400.249834:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947400.249840:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319863040:0@lo:400: 00000100:00100000:0.0:1783947400.249908:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947400.250059:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319862912 00000100:00100000:2.0:1783947400.250066:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319862912 00000100:00100000:2.0:1783947400.250116:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783947400.250125:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:3311:x1870604319862912:12345-0@lo:400: 00000100:00100000:2.0:1783947400.250179:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:3311:x1870604319862912:12345-0@lo:400: Request processed in 55us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947400.250188:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783947400.251698:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319863168:0@lo:400: 00000100:00100000:1.0:1783947400.251760:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947400.251792:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947400.251799:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319863296:0@lo:400: 00000100:00100000:1.0:1783947400.251822:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947400.251889:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319863296 00000100:00100000:1.0:1783947400.251896:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319863296 00000100:00100000:1.0:1783947400.251941:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947400.251949:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319863296:12345-0@lo:400: 00000100:00100000:1.0:1783947400.251997:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319863296:12345-0@lo:400: Request processed in 50us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947400.252004:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1783947400.252021:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783947400.252046:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3c83373480 x1870604319863296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947400.252056:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783947400.252070:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319863296:0@lo:400: 00000100:00100000:3.0:1783947400.253264:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947400.253297:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319863424:0@lo:13: 00000100:00100000:0.0:1783947400.253522:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319862912:0@lo:400: 00000100:00100000:2.0:1783947400.253625:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319863040 00000100:00100000:2.0:1783947400.253632:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319863040 00000100:00100000:2.0:1783947400.253679:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319863168 00000100:00100000:2.0:1783947400.253683:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319863168 00000100:00100000:2.0:1783947400.253719:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947400.253727:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319863040:12345-0@lo:400: 00000100:00100000:2.0:1783947400.253782:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319863040:12345-0@lo:400: Request processed in 56us (3873us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947400.253789:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947400.253804:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783947400.253811:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319863168:12345-0@lo:400: 00000100:00100000:2.0:1783947400.253844:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319863168:12345-0@lo:400: Request processed in 33us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947400.253849:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1783947400.253884:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3c83373100 x1870604319863040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947400.253908:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319863040:0@lo:400: 00000100:00080000:1.0:1783947400.254832:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783947400.254871:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3c83372d80 x1870604319863168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947400.254884:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319863168:0@lo:400: 00000100:00100000:3.0:1783947400.257899:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947400.260062:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319863424 00000100:00100000:3.0:1783947400.260077:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319863424 00000100:00100000:3.0:1783947400.260129:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783947400.260139:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319863424:12345-0@lo:13: 00002000:00000024:3.0:1783947400.260174:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783947400.260313:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319863424:12345-0@lo:13: Request processed in 176us (2421us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947400.260321:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783947400.262437:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3c83374000 x1870604319863424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947400.262465:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319863424:0@lo:13: 00010000:00010000:3.0:1783947400.506150:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947401.529862:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947402.555160:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947403.578946:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947404.612459:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947405.373335:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947405.373370:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319863552:0@lo:13: 00000100:00100000:0.0:1783947405.373456:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947405.373531:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319863552 00000100:00100000:0.0:1783947405.373539:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319863552 00000100:00100000:0.0:1783947405.373597:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947405.373606:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319863552:12345-0@lo:13: 00002000:00000024:0.0:1783947405.373645:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947405.373690:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319863552:12345-0@lo:13: Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947405.373697:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783947405.373736:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3cbd03b100 x1870604319863552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947405.373754:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319863552:0@lo:13: 00000100:00100000:2.0:1783947405.373912:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870604319863808:0@lo:400: 00000100:00100000:2.0:1783947405.373964:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947405.373987:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947405.373993:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319863680:0@lo:400: 00000100:00100000:2.0:1783947405.374020:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947405.374045:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783947405.374052:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1870604319863936:0@lo:400: 00000100:00100000:2.0:1783947405.374078:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947405.374099:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319863808 00000100:00100000:2.0:1783947405.374103:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319863808 00000100:00100000:2.0:1783947405.374129:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319863936 00000100:00100000:2.0:1783947405.374132:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319863936 00000100:00100000:2.0:1783947405.374153:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783947405.374160:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870604319863808:12345-0@lo:400: 00000100:00100000:2.0:1783947405.374195:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870604319863808:12345-0@lo:400: Request processed in 35us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947405.374201:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783947405.374214:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783947405.374220:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870604319863936:12345-0@lo:400: 00000100:00100000:2.0:1783947405.374261:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870604319863936:12345-0@lo:400: Request processed in 41us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947405.374277:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783947405.374295:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319863680 00000100:00100000:2.0:1783947405.374299:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319863680 00000100:00100000:2.0:1783947405.374322:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783947405.374328:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:3314:x1870604319863680:12345-0@lo:400: 00000100:00100000:2.0:1783947405.374358:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:3314:x1870604319863680:12345-0@lo:400: Request processed in 30us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947405.374364:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783947405.374404:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319863680:0@lo:400: 00010000:00080000:2.0:1783947405.374414:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3c83377100 x1870604319863808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947405.374448:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870604319863808:0@lo:400: 00010000:00080000:2.0:1783947405.374473:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3c83375880 x1870604319863936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947405.374482:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1870604319863936:0@lo:400: 00000100:00080000:1.0:1783947405.374988:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947405.374994:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783947405.627015:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947406.649567:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783947406.987235:0:7493:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783947406.987238:0:7493:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1783947406.987371:0:7493:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8b3c83398800 00000020:01000004:1.0:1783947406.989252:0:7493:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1783947406.989273:0:7493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1783947406.989292:0:7493:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8b3b84a8b380) 00000020:00000080:1.0:1783947406.989311:0:7493:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783947407.029020:0:7493:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1783947407.029284:0:7493:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1783947407.088986:0:7493:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1783947407.110506:0:7493:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783947407.110546:0:7493:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1783947407.110604:0:7493:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783947407.110630:0:7493:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1783947407.112065:0:7493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783947407.112093:0:7493:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783947407.112109:0:7493:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x20c3e53e78bb1be9 00000020:01000004:3.0:1783947407.112119:0:7493:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1783947407.112141:0:7493:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.132@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783947407.112145:0:7493:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783947407.112151:0:7493:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783947407.112172:0:7493:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1783947407.112176:0:7493:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.132@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1783947407.178242:0:7493:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.132@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783947407.178285:0:7493:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.132@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1783947407.178290:0:7493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783947407.178292:0:7493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783947407.178293:0:7493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947407.178294:0:7493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947407.178296:0:7493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947407.178297:0:7493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947407.178298:0:7493:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783947407.178300:0:7493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783947407.178301:0:7493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783947407.178303:0:7493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947407.178304:0:7493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783947407.178309:0:7493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1783947407.178311:0:7493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783947407.178312:0:7493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783947407.178313:0:7493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947407.178314:0:7493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947407.178315:0:7493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947407.178317:0:7493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947407.178318:0:7493:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783947407.178319:0:7493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783947407.178320:0:7493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783947407.178321:0:7493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947407.178322:0:7493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783947407.178349:0:7493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783947407.178371:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319864064:0@lo:253: 00000100:00100000:1.0:1783947407.178649:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947407.179466:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8823b600 going to sleep for 11 seconds 00000100:00100000:2.0:1783947407.184020:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319864064 00000100:00100000:2.0:1783947407.184037:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319864064 00000100:00100000:2.0:1783947407.184115:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783947407.184125:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:7493:x1870604319864064:12345-0@lo:253: 20000000:01000000:2.0:1783947407.184159:0:5791:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1783947407.184164:0:5791:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1783947407.184168:0:5791:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1783947407.184172:0:5791:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1783947407.185306:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947407.185583:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1783947407.185596:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1783947407.185636:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1783947407.185644:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1783947407.185676:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1783947407.185726:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1783947407.186098:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1783947407.186118:0:5791:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.132@tcp 20000000:01000000:2.0:1783947407.186120:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.132@tcp (null) (null) (null) 00000040:00080000:2.0:1783947407.186158:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1783947407.186166:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783947407.186215:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1783947407.186236:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.132@tcp (null) (null) 00000040:00080000:2.0:1783947407.186271:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1783947407.186281:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1783947407.186313:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1783947407.186384:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1783947407.187122:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1783947407.187142:0:5791:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.132@tcp 20000000:01000000:2.0:1783947407.187144:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.132@tcp (null) (null) (null) 00000040:00080000:2.0:1783947407.187176:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1783947407.187183:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1783947407.187210:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1783947407.187216:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.132@tcp (null) (null) 00000040:00080000:2.0:1783947407.190174:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1783947407.190204:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1783947407.190300:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1783947407.190343:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1783947407.190373:0:5791:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1783947407.190395:0:5791:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1783947407.190400:0:5791:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1783947407.190442:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783947407.190445:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1783947407.190489:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783947407.190491:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783947407.194937:0:7495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1783947407.195026:0:7495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1783947407.195076:0:7495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1783947407.195561:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1783947407.195603:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1783947407.195661:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1783947407.195675:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1783947407.195678:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783947407.196845:0:7496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1783947407.197206:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1783947407.197270:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1783947407.197339:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1783947407.197353:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783947407.197355:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783947407.210439:0:7497:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1783947407.210533:0:7497:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1783947407.210593:0:7497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1783947407.211079:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1783947407.211151:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1783947407.211211:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1783947407.211238:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1783947407.211241:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783947407.212752:0:7498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1783947407.212845:0:7498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1783947407.212880:0:7498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1783947407.213243:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1783947407.213290:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1783947407.213346:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1783947407.213365:0:5791:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1783947407.213367:0:5791:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1783947407.213376:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783947407.213413:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b3cad73b200/0x20c3e53e78bb1bf0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.213495:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3c80031c00/0x20c3e53e78bb1b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1b3a expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.213503:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1b64 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.213509:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3cad73a000/0x20c3e53e78bb1b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1b8e expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.213515:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1baa expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.213521:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1bd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1bcd expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.213528:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b3cad73b200/0x20c3e53e78bb1bf0 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.213582:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1bcd expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.213596:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1bd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1bcd expref: 16 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947407.213623:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1870604319864192:0@lo:104: 00000100:00100000:1.0:1783947407.213791:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783947407.213843:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1baa expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.213851:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1bb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1baa expref: 16 pid: 5789 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947407.213859:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1870604319864320:0@lo:104: 00010000:00010000:1.0:1783947407.213883:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3cad73a000/0x20c3e53e78bb1b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1b8e expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.213891:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3cad73a000/0x20c3e53e78bb1b95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b8e expref: 16 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947407.213898:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1870604319864448:0@lo:104: 00010000:00010000:1.0:1783947407.213919:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1b64 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.213926:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1b6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b64 expref: 16 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947407.213934:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f52d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1870604319864576:0@lo:104: 00010000:00010000:1.0:1783947407.213955:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3c80031c00/0x20c3e53e78bb1b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1b3a expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.213962:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3c80031c00/0x20c3e53e78bb1b41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b3a expref: 16 pid: 5789 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947407.213982:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f53b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1870604319864704:0@lo:104: 00000100:00100000:1.0:1783947407.214002:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8823bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947407.214156:0:5781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783947407.214174:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947407.214190:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947407.214198:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947407.214206:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947407.214215:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319864192 00000100:00100000:0.0:1783947407.214220:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319864192 00000100:00100000:0.0:1783947407.214262:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319864320 00000100:00100000:0.0:1783947407.214265:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319864320 00000100:00100000:0.0:1783947407.214275:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319864448 00000100:00100000:0.0:1783947407.214278:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319864448 00000100:00100000:0.0:1783947407.214286:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319864576 00000100:00100000:0.0:1783947407.214288:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319864576 00000100:00100000:0.0:1783947407.214297:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319864704 00000100:00100000:0.0:1783947407.214299:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319864704 00000100:00100000:0.0:1783947407.214311:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783947407.214319:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c8338dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+7:5791:x1870604319864192:12345-0@lo:104: 00010000:00010000:0.0:1783947407.214332:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ba00/0x20c3e53e78bb1bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1bd4 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947407.214394:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783947407.214400:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c8338dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+7:5791:x1870604319864192:12345-0@lo:104: Request processed in 82us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947407.214407:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783947407.214464:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783947407.214478:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83370a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+6:5791:x1870604319864320:12345-0@lo:104: 00010000:00010000:0.0:1783947407.214486:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1bb1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947407.214518:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783947407.214528:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83370a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+6:5791:x1870604319864320:12345-0@lo:104: Request processed in 51us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947407.214536:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783947407.214550:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783947407.214556:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+5:5791:x1870604319864448:12345-0@lo:104: 00010000:00010000:0.0:1783947407.214563:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3c80030400/0x20c3e53e78bb1b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1b95 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947407.214587:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783947407.214592:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+5:5791:x1870604319864448:12345-0@lo:104: Request processed in 37us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947407.214597:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783947407.214608:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783947407.214614:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83373100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+4:5791:x1870604319864576:12345-0@lo:104: 00010000:00010000:0.0:1783947407.214620:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1b64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1b6b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947407.214644:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783947407.214648:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83373100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+4:5791:x1870604319864576:12345-0@lo:104: Request processed in 36us (449us total) trans 0 rc 0/0 00010000:00010000:2.0:1783947407.214766:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783947407.214774:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ba00/0x20c3e53e78bb1bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1bd4 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.214781:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73ba00 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:2.0:1783947407.214785:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ba00/0x20c3e53e78bb1bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1bd4 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.214794:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ba00/0x20c3e53e78bb1bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1bd4 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947407.214801:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ba00/0x20c3e53e78bb1bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1bd4 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947407.214807:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947407.214847:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ba00/0x20c3e53e78bb1bcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1bd4 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.214853:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947407.214871:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ba00/0x20c3e53e78bb1bcd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1bd4 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.214885:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ba00/0x20c3e53e78bb1bcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1bd4 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.214898:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783947407.214901:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1bb1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.214907:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c80030e00 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:2.0:1783947407.214910:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1bb1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.214917:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1bb1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947407.214923:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1bb1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947407.214927:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947407.214942:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1baa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1bb1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.214947:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947407.214960:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1baa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1bb1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.214966:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3c80030e00/0x20c3e53e78bb1baa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1bb1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.214975:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947407.214984:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3c80030400/0x20c3e53e78bb1b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1b95 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.214989:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c80030400 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:2.0:1783947407.214992:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80030400/0x20c3e53e78bb1b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1b95 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.214999:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3c80030400/0x20c3e53e78bb1b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1b95 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947407.215005:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80030400/0x20c3e53e78bb1b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1b95 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947407.215010:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947407.215024:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3c80030400/0x20c3e53e78bb1b8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1b95 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.215030:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947407.215036:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3c80030400/0x20c3e53e78bb1b8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1b95 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.215042:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3c80030400/0x20c3e53e78bb1b8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1b95 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.215152:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947407.215155:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1b64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1b6b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.215161:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73ac00 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:2.0:1783947407.215164:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1b64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1b6b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.215179:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1b6b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947407.215186:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1b6b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947407.215190:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947407.215203:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1b64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1b6b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.215208:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947407.215213:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1b64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1b6b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.215220:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1b64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1b6b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.215240:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947407.215242:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947407.215243:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947407.215276:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319864832:0@lo:103: 00000100:00100000:2.0:1783947407.215311:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947407.215350:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783947407.215357:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319865216:0@lo:103: 00000100:00100000:2.0:1783947407.215386:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947407.215415:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319864960:0@lo:103: 00000100:00100000:2.0:1783947407.215467:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947407.215489:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947407.215503:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319865088:0@lo:103: 00000100:00100000:2.0:1783947407.215525:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947407.215551:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319864832 00000100:00100000:2.0:1783947407.215563:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319864832 00010000:00010000:2.0:1783947407.215591:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1bd4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1bcd expref: 17 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947407.215608:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319865216 00000100:00100000:2.0:1783947407.215611:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319865216 00010000:00010000:2.0:1783947407.215621:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1b6b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b64 expref: 18 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947407.215633:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319864960 00000100:00100000:2.0:1783947407.215635:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319864960 00010000:00010000:2.0:1783947407.215645:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1bb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1baa expref: 19 pid: 5789 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947407.215737:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319865088 00000100:00100000:2.0:1783947407.215741:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319865088 00010000:00010000:2.0:1783947407.215755:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3cad73a000/0x20c3e53e78bb1b95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b8e expref: 20 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947407.215769:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947407.215775:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83375500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+20:3312:x1870604319864832:12345-0@lo:103: 00010000:00010000:2.0:1783947407.215790:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947407.215796:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1bd4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1bcd expref: 20 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.215807:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1bd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1bcd expref: 20 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.215824:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947407.215943:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83375500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+20:3312:x1870604319864832:12345-0@lo:103: Request processed in 167us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947407.215950:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947407.215965:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783947407.215972:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83376680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319865216:12345-0@lo:103: 00010000:00010000:2.0:1783947407.215978:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947407.215984:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1b6b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b64 expref: 19 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.215992:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1b6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b64 expref: 19 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.216002:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947407.216022:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83376680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319865216:12345-0@lo:103: Request processed in 51us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947407.216027:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783947407.216039:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783947407.216044:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83376a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:3313:x1870604319864960:12345-0@lo:103: 00010000:00010000:2.0:1783947407.216051:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947407.216055:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1bb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1baa expref: 18 pid: 5789 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.216063:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1bb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1baa expref: 18 pid: 5789 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.216072:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947407.216097:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83376a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:3313:x1870604319864960:12345-0@lo:103: Request processed in 53us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947407.216102:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783947407.216122:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783947407.216128:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:3313:x1870604319865088:12345-0@lo:103: 00010000:00010000:2.0:1783947407.216135:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947407.216139:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3cad73a000/0x20c3e53e78bb1b95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b8e expref: 17 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.216147:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3cad73a000/0x20c3e53e78bb1b95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b8e expref: 17 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.216156:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947407.216178:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:3313:x1870604319865088:12345-0@lo:103: Request processed in 50us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947407.216184:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1783947407.216320:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947407.216402:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783947407.216433:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783947407.216442:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:5791:x1870604319864704:12345-0@lo:104: 00010000:00010000:0.0:1783947407.216458:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1b41 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947407.216506:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783947407.216512:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:5791:x1870604319864704:12345-0@lo:104: Request processed in 73us (2305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947407.216518:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1783947407.216623:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947407.216629:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1b41 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.216636:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a000 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:1.0:1783947407.216640:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1b41 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.216647:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1b3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1b41 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947407.216765:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1b3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1b41 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947407.216771:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947407.216809:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1b3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1b41 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.216815:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947407.216829:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1b3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1b41 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.216836:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1b3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1b41 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947407.217057:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319865088:0@lo:103: 00000100:00100000:2.0:1783947407.217073:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319864960:0@lo:103: 00000100:00100000:2.0:1783947407.217100:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783947407.217111:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319865344:0@lo:103: 00000100:00100000:2.0:1783947407.217155:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947407.217199:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319865216:0@lo:103: 00000100:00100000:2.0:1783947407.217209:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319864832:0@lo:103: 00000100:00100000:2.0:1783947407.217238:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319865344 00000100:00100000:2.0:1783947407.217244:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319865344 00010000:00010000:2.0:1783947407.217264:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3c80031c00/0x20c3e53e78bb1b41 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b3a expref: 17 pid: 5789 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947407.217288:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783947407.217294:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83377100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:3311:x1870604319865344:12345-0@lo:103: 00010000:00010000:2.0:1783947407.217317:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947407.217322:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3c80031c00/0x20c3e53e78bb1b41 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b3a expref: 17 pid: 5789 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.217331:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3c80031c00/0x20c3e53e78bb1b41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b3a expref: 17 pid: 5789 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.217345:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b3cad73b200/0x20c3e53e78bb1bf0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.217352:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cad73b200/0x20c3e53e78bb1bf0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.217366:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3cad73b200/0x20c3e53e78bb1bf0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.217372:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3cad73b200/0x20c3e53e78bb1bf0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.217391:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b3cad73b200/0x20c3e53e78bb1bf0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.217397:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b3cad73b200/0x20c3e53e78bb1bf0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.217403:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b200 already unused, calling callback (ffffffffc1552360) 00010000:00010000:2.0:1783947407.217407:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b3cad73b200/0x20c3e53e78bb1bf0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.217413:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b3cad73b200/0x20c3e53e78bb1bf0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.217464:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b3cad73b200/0x20c3e53e78bb1bf0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.217474:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947407.217502:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83377100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:3311:x1870604319865344:12345-0@lo:103: Request processed in 208us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947407.217508:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783947407.217532:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319865344:0@lo:103: 00010000:00010000:1.0:1783947407.217604:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947407.217614:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947407.217616:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947407.217871:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1bd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1bcd expref: 16 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947407.217882:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1870604319864192:0@lo:104: 00010000:00010000:3.0:1783947407.217892:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1bb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1baa expref: 15 pid: 5789 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947407.217902:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1870604319864320:0@lo:104: 00010000:00010000:3.0:1783947407.217911:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cad73a000/0x20c3e53e78bb1b95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1b8e expref: 14 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947407.217919:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1870604319864448:0@lo:104: 00010000:00010000:3.0:1783947407.217929:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1b6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1b64 expref: 13 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947407.217944:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f52d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1870604319864576:0@lo:104: 00010000:00010000:3.0:1783947407.217955:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c80031c00/0x20c3e53e78bb1b41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1b3a expref: 12 pid: 5789 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947407.217964:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f53b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1870604319864704:0@lo:104: 00010000:00010000:3.0:1783947407.217983:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b3cad73b200/0x20c3e53e78bb1bf0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.217991:0:5791:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b3cad73b200/0x20c3e53e78bb1bf0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.217997:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b3cad73b200/0x20c3e53e78bb1bf0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.218003:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cad73b200/0x20c3e53e78bb1bf0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783947407.218016:0:5791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1783947407.338711:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:7493:x1870604319864064:12345-0@lo:253: Request processed in 154578us (160053us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947407.338727:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783947407.340082:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319864064:0@lo:253: 10000000:01000000:1.0:1783947407.340103:0:7493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783947407.340107:0:7493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783947407.340108:0:7493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783947407.340110:0:7493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947407.340111:0:7493:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1783947407.340113:0:7493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947407.340114:0:7493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947407.340116:0:7493:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783947407.340117:0:7493:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783947407.340119:0:7493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947407.340120:0:7493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783947407.340147:0:7493:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b3c83398800 from lustre-OST0001 10000000:01000000:1.0:1783947407.340178:0:7493:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1783947407.340182:0:7493:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783947407.340190:0:7493:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8b3c85974d40 local copy 10000000:01000000:1.0:1783947407.340194:0:7493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783947407.340238:0:7493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1bf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.340249:0:7493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1bf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.340258:0:7493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1bf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947407.340276:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319865472:0@lo:101: 00000100:00100000:1.0:1783947407.340326:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947407.340473:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319865472 00000100:00100000:3.0:1783947407.340480:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319865472 00000100:00100000:3.0:1783947407.340532:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783947407.340540:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:7493:x1870604319865472:12345-0@lo:101: 00010000:00010000:3.0:1783947407.340552:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947407.340566:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1bfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1bf7 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.340615:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1bf7 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.340625:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1bf7 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.340635:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147d000, rc 0) 00000100:00100000:3.0:1783947407.340663:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:7493:x1870604319865472:12345-0@lo:101: Request processed in 125us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947407.340670:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783947407.340948:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8823b480 going to sleep for 11 seconds 00000100:00100000:1.0:1783947407.340964:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319865472:0@lo:101: 00010000:00010000:1.0:1783947407.340975:0:7493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1bf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x20c3e53e78bb1bfe expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.340993:0:7493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1bf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x20c3e53e78bb1bfe expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947407.341106:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319865600:0@lo:501: 00000100:00100000:1.0:1783947407.341134:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947407.341192:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319865600 00000100:00100000:3.0:1783947407.341196:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319865600 00000100:00100000:3.0:1783947407.341219:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783947407.341237:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:7493:x1870604319865600:12345-0@lo:501: 00000100:00100000:3.0:1783947407.341482:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:7493:x1870604319865600:12345-0@lo:501: Request processed in 244us (346us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783947407.342037:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783947407.342570:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8823b480 going to sleep for 11 seconds 00000100:00100000:0.0:1783947407.342665:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319865600:0@lo:501: 10000000:01000000:0.0:1783947407.342683:0:7493:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783947407.342728:0:7493:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783947407.342735:0:7493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1bf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x20c3e53e78bb1bfe expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947407.342744:0:7493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1bf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x20c3e53e78bb1bfe expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947407.342751:0:7493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1bf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x20c3e53e78bb1bfe expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947407.342774:0:7493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783947407.342798:0:7493:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b3c83398800 10000000:01000000:0.0:1783947407.342803:0:7493:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783947407.342808:0:7493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783947407.342810:0:7493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783947407.342815:0:7493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1783947407.342818:0:7493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783947407.342845:0:7493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030a00/0x20c3e53e78bb1c05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947407.342863:0:7493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3c80030a00/0x20c3e53e78bb1c05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947407.342874:0:7493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3c80030a00/0x20c3e53e78bb1c05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947407.342890:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83372680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319865728:0@lo:101: 00000100:00100000:0.0:1783947407.342932:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947407.343007:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e68240 going to sleep for 11 seconds 00010000:00010000:1.0:1783947407.343062:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947407.343069:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1bf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x20c3e53e78bb1bfe expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.343076:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b600 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:1.0:1783947407.343080:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1bf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x20c3e53e78bb1bfe expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.343088:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1bf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x20c3e53e78bb1bfe expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947407.343095:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1bf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x20c3e53e78bb1bfe expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947407.343100:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947407.343118:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1bf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x20c3e53e78bb1bfe expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.343124:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947407.343155:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1bf7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x20c3e53e78bb1bfe expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.343163:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1bf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x20c3e53e78bb1bfe expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.343185:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947407.343187:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947407.343189:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947407.343234:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947407.343246:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319865856:0@lo:103: 00000100:00100000:0.0:1783947407.343273:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947407.343335:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319865856 00000100:00100000:1.0:1783947407.343341:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319865856 00000100:00100000:1.0:1783947407.343401:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947407.343408:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83373b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:3314:x1870604319865856:12345-0@lo:103: 00010000:00010000:1.0:1783947407.343451:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947407.343464:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1bfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20c3e53e78bb1bf7 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.343479:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947407.343804:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83373b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:3314:x1870604319865856:12345-0@lo:103: Request processed in 395us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947407.343811:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947407.343873:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319865856:0@lo:103: 00000100:00100000:2.0:1783947407.343993:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319865728 00000100:00100000:2.0:1783947407.343998:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319865728 00000100:00100000:2.0:1783947407.344066:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783947407.344074:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+11:7493:x1870604319865728:12345-0@lo:101: 00010000:00010000:2.0:1783947407.344084:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947407.344096:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3ca9d1a400/0x20c3e53e78bb1c0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1c05 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.344114:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3ca9d1a400/0x20c3e53e78bb1c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c05 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.344124:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3ca9d1a400/0x20c3e53e78bb1c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c05 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.344131:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a400, rc 0) 00000100:00100000:2.0:1783947407.344201:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:7493:x1870604319865728:12345-0@lo:101: Request processed in 127us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947407.344207:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783947407.344282:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83372680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319865728:0@lo:101: 00010000:00010000:0.0:1783947407.344294:0:7493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3c80030a00/0x20c3e53e78bb1c05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c0c expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947407.344303:0:7493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3c80030a00/0x20c3e53e78bb1c05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1c0c expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947407.344722:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83372680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319865984:0@lo:501: 00000100:00100000:0.0:1783947407.344753:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947407.344813:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e68240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947407.344897:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319865984 00000100:00100000:2.0:1783947407.344912:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319865984 00000100:00100000:2.0:1783947407.344946:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783947407.344952:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:7493:x1870604319865984:12345-0@lo:501: 00000100:00100000:2.0:1783947407.345151:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:7493:x1870604319865984:12345-0@lo:501: Request processed in 197us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947407.345158:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783947407.345281:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83372680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319865984:0@lo:501: 00000100:00100000:0.0:1783947407.345306:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83372680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319866112:0@lo:503: 00000100:00100000:0.0:1783947407.345343:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947407.345367:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e68240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947407.345653:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319866112 00000100:00100000:2.0:1783947407.345658:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319866112 00000100:00100000:2.0:1783947407.345676:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783947407.345682:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:7493:x1870604319866112:12345-0@lo:503: 00000100:00100000:2.0:1783947407.346081:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:7493:x1870604319866112:12345-0@lo:503: Request processed in 397us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947407.346088:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783947407.346180:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83372680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319866112:0@lo:503: 00000040:00080000:0.0:1783947407.346862:0:7493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783947407.346921:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83372680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319866240:0@lo:502: 00000100:00100000:0.0:1783947407.346971:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947407.347195:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e68240 going to sleep for 11 seconds 00000100:00100000:1.0:1783947407.347248:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319866240 00000100:00100000:1.0:1783947407.347255:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319866240 00000100:00100000:1.0:1783947407.347332:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783947407.347341:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:7493:x1870604319866240:12345-0@lo:502: 00000100:00100000:1.0:1783947407.347864:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:7493:x1870604319866240:12345-0@lo:502: Request processed in 524us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947407.347873:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783947407.347961:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83372680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319866240:0@lo:502: 00000040:00080000:0.0:1783947407.348231:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783947407.348286:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1783947407.348320:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1783947407.348363:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1783947407.348410:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1783947407.348463:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1783947407.348502:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83372680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319866368:0@lo:502: 00000100:00100000:0.0:1783947407.348543:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947407.349189:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e68240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947407.349266:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319866368 00000100:00100000:2.0:1783947407.349273:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319866368 00000100:00100000:2.0:1783947407.349307:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783947407.349315:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:7493:x1870604319866368:12345-0@lo:502: 00000100:00100000:2.0:1783947407.349538:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:7493:x1870604319866368:12345-0@lo:502: Request processed in 223us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947407.349546:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783947407.349744:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83372680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319866368:0@lo:502: 00000040:00080000:0.0:1783947407.349874:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1783947407.349886:0:7493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1783947407.354119:0:7500:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783947407.354131:0:7500:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1783947407.354137:0:7500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947407.354140:0:7500:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1783947407.354146:0:7500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783947407.354161:0:7500:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8b3cbd3b8000) 00000020:00000080:2.0:1783947407.354184:0:7500:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783947407.354189:0:7500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783947407.354342:0:7500:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b3c83398800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1783947407.354349:0:7500:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783947407.354355:0:7500:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x20c3e53e78bb1c1a 00010000:00010000:0.0:1783947407.368912:0:7500:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1783947407.369242:0:7500:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1783947407.377546:0:7500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1783947407.378047:0:7500:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1783947407.384320:0:7500:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1783947407.387803:0:7500:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1783947407.390073:0:7500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1783947407.390085:0:7500:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947407.390091:0:7500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947407.390093:0:7500:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1783947407.390096:0:7500:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947407.390101:0:7500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947407.390102:0:7500:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783947407.390105:0:7500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783947407.390107:0:7500:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783947407.390158:0:7500:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947407.390162:0:7500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947407.390163:0:7500:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783947407.390166:0:7500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1783947407.390338:0:7493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1783947407.390367:0:7493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783947407.390396:0:7493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030a00/0x20c3e53e78bb1c05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c0c expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.390448:0:7493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c80030a00/0x20c3e53e78bb1c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c0c expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947407.390457:0:7493:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3c83398800 from 1 10000000:01000000:1.0:1783947407.390460:0:7493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947407.390505:0:7493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1c21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.390514:0:7493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1c21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.390525:0:7493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1c21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947407.390548:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319866496:0@lo:101: 00000100:00100000:1.0:1783947407.390620:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947407.390662:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8823b180 going to sleep for 11 seconds 00000100:00100000:3.0:1783947407.390798:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319866496 00000100:00100000:3.0:1783947407.390804:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319866496 00000100:00100000:3.0:1783947407.390848:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783947407.390858:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:7493:x1870604319866496:12345-0@lo:101: 00010000:00010000:3.0:1783947407.390871:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947407.390883:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1c28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1c21 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.390904:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1c28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c21 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.390927:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1c28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c21 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.390935:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147d600, rc 0) 00000100:00100000:3.0:1783947407.390974:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:7493:x1870604319866496:12345-0@lo:101: Request processed in 118us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947407.390981:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783947407.391272:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319866496:0@lo:101: 00010000:00010000:1.0:1783947407.391288:0:7493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1c21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c28 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.391299:0:7493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1c21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1c28 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947407.391409:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319866624:0@lo:501: 00000100:00100000:1.0:1783947407.391704:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947407.391737:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8823b180 going to sleep for 11 seconds 00000100:00100000:1.0:1783947407.391764:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319866624 00000100:00100000:1.0:1783947407.391956:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319866624 00000100:00100000:1.0:1783947407.391994:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783947407.392001:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:7493:x1870604319866624:12345-0@lo:501: 00000100:00100000:1.0:1783947407.392207:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:7493:x1870604319866624:12345-0@lo:501: Request processed in 205us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947407.392215:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783947407.392257:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319866624:0@lo:501: 00000100:00100000:1.0:1783947407.392286:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319866752:0@lo:503: 00000100:00100000:1.0:1783947407.392324:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947407.392336:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8823b180 going to sleep for 11 seconds 00000100:00100000:1.0:1783947407.392353:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319866752 00000100:00100000:1.0:1783947407.392357:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319866752 00000100:00100000:1.0:1783947407.392371:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783947407.392739:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:7493:x1870604319866752:12345-0@lo:503: 00000100:00100000:1.0:1783947407.393192:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:7493:x1870604319866752:12345-0@lo:503: Request processed in 813us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947407.393200:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783947407.403280:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319866752:0@lo:503: 00000040:00080000:2.0:1783947407.404078:0:7493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783947407.404160:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319866880:0@lo:502: 00000100:00100000:2.0:1783947407.404246:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947407.404292:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb6ba06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947407.406106:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319866880 00000100:00100000:0.0:1783947407.406127:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319866880 00000100:00100000:0.0:1783947407.406177:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783947407.406187:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:7493:x1870604319866880:12345-0@lo:502: 00000100:00100000:0.0:1783947407.406689:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:7493:x1870604319866880:12345-0@lo:502: Request processed in 502us (2442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947407.406698:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783947407.408865:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319866880:0@lo:502: 00000040:00080000:2.0:1783947407.409201:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1783947407.409275:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1783947407.409316:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319867008:0@lo:502: 00000100:00100000:2.0:1783947407.409394:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947407.409476:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb6ba06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947407.409727:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319867008 00000100:00100000:3.0:1783947407.409735:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319867008 00000100:00100000:3.0:1783947407.409781:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783947407.409790:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:7493:x1870604319867008:12345-0@lo:502: 00000100:00100000:3.0:1783947407.410000:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:7493:x1870604319867008:12345-0@lo:502: Request processed in 211us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947407.410009:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783947407.410905:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319867008:0@lo:502: 00000040:00080000:2.0:1783947407.411070:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1783947407.411094:0:7493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1783947407.412092:0:7504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947407.412103:0:7504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947407.412105:0:7504:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783947407.412110:0:7504:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b3c83398800 00000020:00000080:2.0:1783947407.412113:0:7504:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783947407.412131:0:7504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947407.412134:0:7504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947407.412135:0:7504:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783947407.412138:0:7504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1783947407.412282:0:7493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783947407.412303:0:7493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947407.412325:0:7493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1c21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c28 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.412336:0:7493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1c21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c28 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947407.412382:0:7493:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783947407.412385:0:7493:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b3c83398800 10000000:01000000:1.0:1783947407.412397:0:7493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b3c83398800 10000000:01000000:1.0:1783947407.412401:0:7493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783947407.412407:0:7493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b3c83398800 from 1 10000000:01000000:1.0:1783947407.412410:0:7493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783947407.412739:0:7493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a200/0x20c3e53e78bb1c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.412749:0:7493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a200/0x20c3e53e78bb1c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.412758:0:7493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a200/0x20c3e53e78bb1c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947407.412788:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f53100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319867136:0@lo:101: 00000100:00100000:1.0:1783947407.412847:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947407.412926:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8823b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947407.414242:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319867136 00000100:00100000:3.0:1783947407.414254:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319867136 00000100:00100000:3.0:1783947407.414370:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783947407.414390:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:7493:x1870604319867136:12345-0@lo:101: 00010000:00010000:3.0:1783947407.414406:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947407.414663:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c8147d800/0x20c3e53e78bb1c36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1c2f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.414692:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c8147d800/0x20c3e53e78bb1c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c2f expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.414705:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c8147d800/0x20c3e53e78bb1c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c2f expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.414731:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147d800, rc 0) 00000100:00100000:3.0:1783947407.414847:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:7493:x1870604319867136:12345-0@lo:101: Request processed in 459us (1999us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947407.414855:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783947407.415147:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f53100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319867136:0@lo:101: 00010000:00010000:2.0:1783947407.415167:0:7493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a200/0x20c3e53e78bb1c2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c36 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.415177:0:7493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a200/0x20c3e53e78bb1c2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1c36 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947407.415298:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319867264:0@lo:501: 00000100:00100000:2.0:1783947407.415331:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947407.415407:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb6ba0300 going to sleep for 11 seconds 00000100:00100000:3.0:1783947407.416004:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319867264 00000100:00100000:3.0:1783947407.416010:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319867264 00000100:00100000:3.0:1783947407.416055:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783947407.416063:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:7493:x1870604319867264:12345-0@lo:501: 00000100:00100000:3.0:1783947407.416324:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:7493:x1870604319867264:12345-0@lo:501: Request processed in 261us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947407.416331:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783947407.416818:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319867264:0@lo:501: 00000100:00100000:2.0:1783947407.416860:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319867392:0@lo:503: 00000100:00100000:2.0:1783947407.416912:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947407.416942:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb6ba0300 going to sleep for 11 seconds 00000100:00100000:1.0:1783947407.418277:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319867392 00000100:00100000:1.0:1783947407.418289:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319867392 00000100:00100000:1.0:1783947407.418348:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783947407.418357:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:7493:x1870604319867392:12345-0@lo:503: 00000100:00100000:1.0:1783947407.418667:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:7493:x1870604319867392:12345-0@lo:503: Request processed in 310us (1753us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947407.418675:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783947407.419042:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319867392:0@lo:503: 00000040:00080000:2.0:1783947407.419375:0:7493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783947407.419505:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319867520:0@lo:502: 00000100:00100000:2.0:1783947407.419559:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947407.419615:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319867520 00000100:00100000:2.0:1783947407.419620:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319867520 00000100:00100000:2.0:1783947407.419654:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783947407.419662:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:7493:x1870604319867520:12345-0@lo:502: 00000100:00100000:2.0:1783947407.419870:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:7493:x1870604319867520:12345-0@lo:502: Request processed in 206us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947407.419877:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783947407.419923:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb6ba0300 going to sleep for 11 seconds 00000100:00100000:2.0:1783947407.419937:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319867520:0@lo:502: 00000040:00080000:2.0:1783947407.420175:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1783947407.420219:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1783947407.420268:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1783947407.420314:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1783947407.420350:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1783947407.420406:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1783947407.420468:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1783947407.420502:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1783947407.420543:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1783947407.420575:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1783947407.420604:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1783947407.420664:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1783947407.420698:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1783947407.420730:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1783947407.420774:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1783947407.420811:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1783947407.420846:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1783947407.420894:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1783947407.420928:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1783947407.420962:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1783947407.421024:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1783947407.421062:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1783947407.421111:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1783947407.421159:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1783947407.421195:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1783947407.421238:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1783947407.421294:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1783947407.421337:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1783947407.421365:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1783947407.421408:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1783947407.421468:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1783947407.421504:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1783947407.421538:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1783947407.421588:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1783947407.421626:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1783947407.421679:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1783947407.421724:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1783947407.421766:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319867648:0@lo:502: 00000100:00100000:2.0:1783947407.421830:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947407.421863:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319867648 00000100:00100000:0.0:1783947407.421871:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319867648 00000100:00100000:2.0:1783947407.421887:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb6ba0300 going to sleep for 11 seconds 00000100:00100000:0.0:1783947407.421921:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783947407.421931:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:7493:x1870604319867648:12345-0@lo:502: 00000100:00100000:0.0:1783947407.422140:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:7493:x1870604319867648:12345-0@lo:502: Request processed in 210us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947407.422147:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783947407.423783:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319867648:0@lo:502: 00000040:00080000:2.0:1783947407.423925:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1783947407.423941:0:7493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1783947407.425149:0:7505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783947407.425167:0:7505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8b3cbd3b99c0) 00000020:00000080:2.0:1783947407.425190:0:7505:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1783947407.428353:0:7505:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b3c83398800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783947407.428364:0:7505:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b3c83398800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783947407.428368:0:7505:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b3c83398800 3 00010000:00080000:2.0:1783947407.428444:0:7505:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b3c9e5ff800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.132@tcp at head 00010000:00010000:2.0:1783947407.431151:0:7505:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1783947407.431262:0:7505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1783947407.431310:0:7505:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783947407.431323:0:7505:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x20c3e53e78bb1c44 00000100:00080000:2.0:1783947407.431332:0:7505:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783947407.431337:0:7505:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b3c9e5ff800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1783947407.431372:0:7505:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3c83375880 x1870604319867776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783947407.433208:0:7505:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783947407.433625:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947407.433644:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319867904:0@lo:400: 00000100:00100000:3.0:1783947407.433708:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947407.433746:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319868032:0@lo:400: 00000100:00100000:3.0:1783947407.433781:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947407.433803:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947407.433808:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319868160:0@lo:400: 00000100:00100000:3.0:1783947407.433833:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947407.433866:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319867904 00000100:00100000:3.0:1783947407.433874:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319867904 00000100:00100000:3.0:1783947407.433918:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319868032 00000100:00100000:3.0:1783947407.433921:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319868032 00000100:00100000:3.0:1783947407.433952:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947407.433960:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319867904:12345-0@lo:400: 00000100:00100000:3.0:1783947407.434011:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319867904:12345-0@lo:400: Request processed in 51us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947407.434030:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947407.434050:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947407.434056:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319868032:12345-0@lo:400: 00000100:00100000:3.0:1783947407.434090:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319868032:12345-0@lo:400: Request processed in 33us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947407.434095:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947407.434121:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319868160 00000100:00100000:3.0:1783947407.434125:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319868160 00000100:00100000:3.0:1783947407.434151:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947407.434157:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319868160:12345-0@lo:400: 00000100:00100000:3.0:1783947407.434185:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319868160:12345-0@lo:400: Request processed in 29us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947407.434191:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1783947407.434209:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783947407.434214:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783947407.434250:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3cbd039880 x1870604319867904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947407.434264:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319867904:0@lo:400: 00010000:00080000:3.0:1783947407.434289:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3cbd039f80 x1870604319868160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947407.434298:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319868160:0@lo:400: 00010000:00080000:3.0:1783947407.434307:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3cbd038e00 x1870604319868032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947407.434315:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319868032:0@lo:400: 00000100:00100000:1.0:1783947407.434772:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1870604319867776:0@lo:38: 00000100:00100000:1.0:1783947407.434813:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1783947407.435193:0:7505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:1.0:1783947407.437797:0:7507:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8b3c84f53800 x1870604319868288/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947407.437811:0:7507:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8823b9c0 going to sleep for 0 seconds 00000100:00100000:3.0:1783947407.439334:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319867776 00000100:00100000:3.0:1783947407.439361:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319867776 00000100:00100000:3.0:1783947407.439756:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783947407.439764:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1870604319867776:12345-0@lo:38: 00010000:00080000:3.0:1783947407.439960:0:5795:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:3.0:1783947407.439995:0:5795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x20c3e53e78bb1c4b 00000004:00100000:3.0:1783947407.440013:0:5795:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783947407.440047:0:5795:0:(import.c:65:import_set_state_nolock()) ffff8b3cb6398800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947407.440192:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1870604319867776:12345-0@lo:38: Request processed in 426us (5377us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947407.440199:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000000:0.0:1783947407.443251:0:7493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1783947407.443294:0:7493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783947407.443309:0:7493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a200/0x20c3e53e78bb1c2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c36 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947407.443322:0:7493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a200/0x20c3e53e78bb1c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c36 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783947407.443397:0:7493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783947407.443400:0:7493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783947407.443401:0:7493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947407.443402:0:7493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947407.443403:0:7493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947407.443405:0:7493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947407.443406:0:7493:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783947407.443408:0:7493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783947407.443409:0:7493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783947407.443411:0:7493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947407.443437:0:7493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783947407.443441:0:7493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1783947407.443444:0:7493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783947407.443445:0:7493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783947407.443446:0:7493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947407.443447:0:7493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947407.443448:0:7493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947407.443449:0:7493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947407.443450:0:7493:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783947407.443451:0:7493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783947407.443452:0:7493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783947407.443453:0:7493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947407.443454:0:7493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783947407.443481:0:7493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783947407.443509:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83372680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319868416:0@lo:253: 00000100:00100000:0.0:1783947407.443573:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947407.443782:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e68300 going to sleep for 11 seconds 00000100:00100000:2.0:1783947407.443972:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319868416 00000100:00100000:2.0:1783947407.443981:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319868416 00000100:00100000:2.0:1783947407.444040:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783947407.444051:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:7493:x1870604319868416:12345-0@lo:253: 20000000:01000000:2.0:1783947407.444078:0:5789:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783947407.444096:0:5789:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1783947407.445548:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3c83375880 x1870604319867776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947407.445572:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783947407.445593:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1783947407.445602:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783947407.445608:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783947407.445611:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3c9e5ff800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1783947407.445620:0:3310:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ddf2f6ba): req@ffff8b3c84f53800 x1870604319868288/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947407.445637:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1870604319867776:0@lo:38: 00000100:00100000:3.0:1783947407.446449:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947407.446471:0:7507:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8823b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947407.446761:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319868288 00000100:00100000:1.0:1783947407.446768:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319868288 00000100:00100000:1.0:1783947407.446828:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947407.446836:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7507:x1870604319868288:12345-0@lo:901: 00000100:00080000:3.0:1783947407.446949:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947407.447353:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7507:x1870604319868288:12345-0@lo:901: Request processed in 516us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947407.447361:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783947407.447794:0:7507:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3c84f53800 x1870604319868288/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783947423 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947407.447807:0:7507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f53800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7507:1870604319868288:0@lo:901: 20000000:01000000:2.0:1783947407.499099:0:5789:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783947407.499118:0:5789:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1783947407.499178:0:5812:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783947407.499182:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783947407.499204:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b3cad73b800/0x20c3e53e78bb1c52 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.499233:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1b9c expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.499242:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b3cad73b800/0x20c3e53e78bb1c52 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.499286:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1b9c expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.499315:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1ba3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b9c expref: 14 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947407.499331:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f53800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1870604319868544:0@lo:104: 00000100:00100000:1.0:1783947407.499407:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947407.499499:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8823b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947407.499940:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319868544 00000100:00100000:2.0:1783947407.499949:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319868544 00000100:00100000:2.0:1783947407.500001:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783947407.500010:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:5812:x1870604319868544:12345-0@lo:104: 00010000:00010000:2.0:1783947407.500024:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1b9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1ba3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947407.500080:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783947407.500086:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:5812:x1870604319868544:12345-0@lo:104: Request processed in 77us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947407.500093:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1783947407.500340:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947407.500347:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1b9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1ba3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.500354:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c80030600 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:1.0:1783947407.500359:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1b9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1ba3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.500367:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1ba3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947407.500380:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1ba3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947407.500386:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947407.500458:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1b9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1ba3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.500466:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947407.500496:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1b9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1ba3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.500504:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1b9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1ba3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.500536:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947407.500537:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947407.500539:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947407.500554:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319868672:0@lo:103: 00000100:00100000:1.0:1783947407.501134:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947407.501214:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f53800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1870604319868544:0@lo:104: 00010000:00010000:1.0:1783947407.501245:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b3cad73b800/0x20c3e53e78bb1c52 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947407.501451:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319868672 00000100:00100000:3.0:1783947407.501458:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319868672 00010000:00010000:3.0:1783947407.501494:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1ba3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b9c expref: 15 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947407.501524:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947407.501532:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c856ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:3313:x1870604319868672:12345-0@lo:103: 00010000:00010000:3.0:1783947407.501544:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947407.501550:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1ba3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b9c expref: 15 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.501559:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b9c expref: 15 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.501596:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1ba3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1b9c expref: 15 pid: 5790 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.501612:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b3cad73b800/0x20c3e53e78bb1c52 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.501620:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cad73b800/0x20c3e53e78bb1c52 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783947407.501635:0:5784:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002452551s 00010000:00010000:3.0:1783947407.501639:0:5784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3cad73b800/0x20c3e53e78bb1c52 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.501645:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3cad73b800/0x20c3e53e78bb1c52 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.501652:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b3cad73b800/0x20c3e53e78bb1c52 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.501659:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b3cad73b800/0x20c3e53e78bb1c52 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.501665:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b800 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947407.501669:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b3cad73b800/0x20c3e53e78bb1c52 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.501676:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b3cad73b800/0x20c3e53e78bb1c52 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.501688:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b3cad73b800/0x20c3e53e78bb1c52 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947407.501707:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947407.501746:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c856ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:3313:x1870604319868672:12345-0@lo:103: Request processed in 215us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947407.501753:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783947407.502290:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319868672:0@lo:103: 00010000:00010000:1.0:1783947407.502313:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b3cad73b800/0x20c3e53e78bb1c52 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.502322:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b3cad73b800/0x20c3e53e78bb1c52 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947407.502328:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cad73b800/0x20c3e53e78bb1c52 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947407.520076:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:7493:x1870604319868416:12345-0@lo:253: Request processed in 76017us (76492us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947407.520091:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783947407.520191:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83372680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7493:1870604319868416:0@lo:253: 10000000:01000000:2.0:1783947407.520219:0:7493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783947407.520232:0:7493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783947407.520233:0:7493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783947407.520235:0:7493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947407.520236:0:7493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947407.520238:0:7493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947407.520239:0:7493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947407.520241:0:7493:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947407.520242:0:7493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783947407.520244:0:7493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783947407.520245:0:7493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947407.520246:0:7493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783947407.520261:0:7493:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783947407.527936:0:7493:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1783947407.528132:0:7493:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783947407.528360:0:7493:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1783947407.528581:0:7493:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783947407.528775:0:7493:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1783947407.529028:0:7493:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1783947407.534353:0:7493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1783947407.677816:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1783947407.856755:0:7493:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1783947407.856763:0:7493:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1783947407.856794:0:7493:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783947407.856858:0:7493:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.132@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783947407.856871:0:7493:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1783947407.856898:0:7493:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1783947408.702524:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947409.723824:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947410.494596:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947410.494621:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319868800:0@lo:13: 00000100:00100000:3.0:1783947410.494687:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947410.494743:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319868800 00000100:00100000:3.0:1783947410.494751:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319868800 00000100:00100000:3.0:1783947410.494803:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783947410.494811:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319868800:12345-0@lo:13: 00002000:00000024:3.0:1783947410.494844:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783947410.494905:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319868800:12345-0@lo:13: Request processed in 95us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947410.494913:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1783947410.494936:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783947410.494965:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd039f80 x1870604319868800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947410.494982:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319868800:0@lo:13: 00010000:00010000:1.0:1783947410.745895:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947411.769796:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947412.538602:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319869184:0@lo:400: 00000100:00100000:3.0:1783947412.538702:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947412.538818:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319868928:0@lo:400: 00000100:00100000:0.0:1783947412.538860:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947412.539004:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319869056:0@lo:400: 00000100:00100000:2.0:1783947412.539040:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947412.539281:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947412.539289:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319869312:0@lo:400: 00000100:00100000:3.0:1783947412.539321:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947412.539362:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319869184 00000100:00100000:3.0:1783947412.539371:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319869184 00000100:00100000:3.0:1783947412.539606:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319869056 00000100:00100000:3.0:1783947412.539623:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319869056 00000100:00100000:3.0:1783947412.539713:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783947412.539725:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319869184:12345-0@lo:400: 00000100:00100000:3.0:1783947412.539822:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319869184:12345-0@lo:400: Request processed in 100us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947412.539830:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783947412.539850:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783947412.539856:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319869056:12345-0@lo:400: 00000100:00100000:3.0:1783947412.539889:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319869056:12345-0@lo:400: Request processed in 33us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947412.539895:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1783947412.539923:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783947412.539965:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd038700 x1870604319869184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947412.539982:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319869184:0@lo:400: 00000100:00100000:0.0:1783947412.540337:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319869440:0@lo:400: 00000100:00100000:0.0:1783947412.540405:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947412.540502:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319869440 00000100:00100000:0.0:1783947412.540503:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319868928 00000100:00100000:3.0:1783947412.540511:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319869440 00000100:00100000:0.0:1783947412.540514:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319868928 00000100:00100000:0.0:1783947412.540572:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783947412.540578:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783947412.540586:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:3311:x1870604319868928:12345-0@lo:400: 00000100:00100000:3.0:1783947412.540596:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319869440:12345-0@lo:400: 00000100:00100000:0.0:1783947412.540673:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:3311:x1870604319868928:12345-0@lo:400: Request processed in 90us (1810us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947412.540682:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783947412.540814:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319869312 00000100:00100000:0.0:1783947412.540820:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319869312 00000100:00100000:0.0:1783947412.540879:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947412.540886:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319869312:12345-0@lo:400: 00000100:00100000:0.0:1783947412.540935:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319869312:12345-0@lo:400: Request processed in 50us (1613us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947412.540942:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947412.540987:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319868928:0@lo:400: 00010000:00080000:0.0:1783947412.541029:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd038a80 x1870604319869312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947412.541041:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319869312:0@lo:400: 00010000:00080000:2.0:1783947412.544066:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd039180 x1870604319869056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947412.544092:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319869056:0@lo:400: 00000100:00080000:2.0:1783947412.544589:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783947412.544597:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947412.548429:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319869440:12345-0@lo:400: Request processed in 7820us (8002us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947412.548468:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1783947412.548697:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd03b100 x1870604319869440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947412.548726:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319869440:0@lo:400: 00010000:00010000:0.0:1783947412.794379:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947413.830191:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947414.841878:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947415.614216:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83372680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319869568:0@lo:13: 00000100:00100000:3.0:1783947415.614290:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947415.614414:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319869568 00000100:00100000:0.0:1783947415.614438:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319869568 00000100:00100000:0.0:1783947415.614501:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947415.614510:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319869568:12345-0@lo:13: 00002000:00000024:0.0:1783947415.614549:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947415.614591:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319869568:12345-0@lo:13: Request processed in 83us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947415.614599:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1783947415.614621:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1783947415.620077:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783947415.620086:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b3cb6183000 from 30 10000000:01000000:1.0:1783947415.620091:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783947415.620139:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ae00/0x20c3e53e78bb1c59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947415.620153:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ae00/0x20c3e53e78bb1c59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947415.620174:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ae00/0x20c3e53e78bb1c59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947415.620201:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319869696:0@lo:101: 00000100:00100000:1.0:1783947415.620272:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783947415.623121:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c83372680 x1870604319869568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947415.623149:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83372680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319869568:0@lo:13: 00000100:00100000:1.0:1783947415.623779:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb673f900 going to sleep for 11 seconds 00000100:00100000:1.0:1783947415.623803:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319869696 00000100:00100000:1.0:1783947415.623811:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319869696 00000100:00100000:1.0:1783947415.623910:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783947415.623919:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:5793:x1870604319869696:12345-0@lo:101: 00010000:00010000:1.0:1783947415.623935:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947415.623955:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cad73b400/0x20c3e53e78bb1c60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1c59 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947415.623996:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cad73b400/0x20c3e53e78bb1c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c59 expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947415.624007:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cad73b400/0x20c3e53e78bb1c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c59 expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947415.624024:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73b400, rc 0) 00000100:00100000:1.0:1783947415.624105:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:5793:x1870604319869696:12345-0@lo:101: Request processed in 187us (3833us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947415.624112:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783947415.624895:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319869696:0@lo:101: 00010000:00010000:3.0:1783947415.624918:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ae00/0x20c3e53e78bb1c59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c60 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947415.624929:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ae00/0x20c3e53e78bb1c59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1c60 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947415.625012:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319869824:0@lo:501: 00000100:00100000:3.0:1783947415.625057:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947415.625291:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e68d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947415.625443:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319869824 00000100:00100000:0.0:1783947415.625450:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319869824 00000100:00100000:0.0:1783947415.625485:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783947415.625495:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:5793:x1870604319869824:12345-0@lo:501: 00000100:00100000:3.0:1783947415.626262:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319869824:0@lo:501: 00000100:00100000:3.0:1783947415.626298:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319869952:0@lo:503: 00000100:00100000:0.0:1783947415.626413:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:5793:x1870604319869824:12345-0@lo:501: Request processed in 919us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947415.626447:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783947415.628095:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947415.628178:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e68d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947415.630692:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319869952 00000100:00100000:0.0:1783947415.630706:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319869952 00000100:00100000:0.0:1783947415.630769:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783947415.630778:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:5793:x1870604319869952:12345-0@lo:503: 00000100:00100000:0.0:1783947415.631508:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:5793:x1870604319869952:12345-0@lo:503: Request processed in 727us (3415us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947415.631517:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783947415.633137:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319869952:0@lo:503: 00000100:00100000:0.0:1783947415.640847:0:7797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7797:1870604319870080:0@lo:502: 00000100:00100000:0.0:1783947415.640934:0:7797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947415.640997:0:7797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb66f2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783947415.641100:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319870080 00000100:00100000:1.0:1783947415.641108:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319870080 00000100:00100000:1.0:1783947415.641172:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783947415.641181:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:7797:x1870604319870080:12345-0@lo:502: 00000100:00100000:1.0:1783947415.641644:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:7797:x1870604319870080:12345-0@lo:502: Request processed in 462us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947415.641653:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783947415.641849:0:7797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7797:1870604319870080:0@lo:502: 00000100:00100000:0.0:1783947415.641905:0:7797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7797:1870604319870208:0@lo:502: 00000100:00100000:0.0:1783947415.641948:0:7797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947415.641987:0:7797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb66f2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783947415.642081:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319870208 00000100:00100000:1.0:1783947415.642087:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319870208 00000100:00100000:1.0:1783947415.642124:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783947415.642131:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:7797:x1870604319870208:12345-0@lo:502: 00000100:00100000:1.0:1783947415.642300:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:7797:x1870604319870208:12345-0@lo:502: Request processed in 168us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947415.642307:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783947415.642438:0:7797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7797:1870604319870208:0@lo:502: 00000040:00080000:0.0:1783947415.642461:0:7797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1783947415.642629:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1783947415.642647:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783947415.642724:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ae00/0x20c3e53e78bb1c59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c60 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947415.642737:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ae00/0x20c3e53e78bb1c59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c60 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947415.642753:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783947415.642756:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1783947415.642758:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783947415.642782:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a400/0x20c3e53e78bb1c67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947415.642789:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a400/0x20c3e53e78bb1c67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947415.642798:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a400/0x20c3e53e78bb1c67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947415.642811:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319870336:0@lo:101: 00000100:00100000:1.0:1783947415.642840:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947415.642900:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb673f240 going to sleep for 11 seconds 00000100:00100000:0.0:1783947415.643084:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319870336 00000100:00100000:0.0:1783947415.643090:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319870336 00000100:00100000:0.0:1783947415.643159:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783947415.643177:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:5793:x1870604319870336:12345-0@lo:101: 00010000:00010000:0.0:1783947415.643190:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947415.643203:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c80030000/0x20c3e53e78bb1c6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1c67 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947415.643226:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c80030000/0x20c3e53e78bb1c6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c67 expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947415.643245:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c80030000/0x20c3e53e78bb1c6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c67 expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947415.643254:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c80030000, rc 0) 00000100:00100000:0.0:1783947415.643301:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:5793:x1870604319870336:12345-0@lo:101: Request processed in 135us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947415.643309:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783947415.643441:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319870336:0@lo:101: 00010000:00010000:2.0:1783947415.643455:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a400/0x20c3e53e78bb1c67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c6e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.643475:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a400/0x20c3e53e78bb1c67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1c6e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947415.643521:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319870464:0@lo:501: 00000100:00100000:2.0:1783947415.643548:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947415.644200:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb61a70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947415.644250:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319870464 00000100:00100000:0.0:1783947415.644256:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319870464 00000100:00100000:0.0:1783947415.644280:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783947415.644287:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:5793:x1870604319870464:12345-0@lo:501: 00000100:00100000:0.0:1783947415.644618:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:5793:x1870604319870464:12345-0@lo:501: Request processed in 330us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947415.644626:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783947415.644776:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319870464:0@lo:501: 00000100:00100000:2.0:1783947415.644812:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319870592:0@lo:503: 00000100:00100000:2.0:1783947415.644853:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947415.644874:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319870592 00000100:00100000:2.0:1783947415.644878:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319870592 00000100:00100000:2.0:1783947415.644898:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783947415.644904:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:5793:x1870604319870592:12345-0@lo:503: 00000100:00100000:2.0:1783947415.645203:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:5793:x1870604319870592:12345-0@lo:503: Request processed in 298us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947415.645210:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783947415.645248:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb61a70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947415.645260:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319870592:0@lo:503: 00000100:00100000:2.0:1783947415.645857:0:7798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7798:1870604319870720:0@lo:502: 00000100:00100000:2.0:1783947415.645901:0:7798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947415.645924:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319870720 00000100:00100000:2.0:1783947415.645929:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319870720 00000100:00100000:2.0:1783947415.645953:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783947415.646025:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:7798:x1870604319870720:12345-0@lo:502: 00000100:00100000:2.0:1783947415.646221:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:7798:x1870604319870720:12345-0@lo:502: Request processed in 261us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947415.646228:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783947415.646260:0:7798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb61a7240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947415.646273:0:7798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7798:1870604319870720:0@lo:502: 00000020:01000000:2.0:1783947415.646295:0:7798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947415.646303:0:7798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947415.646305:0:7798:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783947415.646309:0:7798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783947415.646310:0:7798:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783947415.646472:0:7798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7798:1870604319870848:0@lo:502: 00000100:00100000:2.0:1783947415.646507:0:7798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947415.646529:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319870848 00000100:00100000:2.0:1783947415.646533:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319870848 00000100:00100000:2.0:1783947415.646552:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783947415.646558:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:7798:x1870604319870848:12345-0@lo:502: 00000100:00100000:2.0:1783947415.646730:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:7798:x1870604319870848:12345-0@lo:502: Request processed in 172us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947415.646737:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783947415.646764:0:7798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb61a7240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947415.646776:0:7798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7798:1870604319870848:0@lo:502: 00000020:01000000:2.0:1783947415.646793:0:7798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947415.646798:0:7798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947415.646800:0:7798:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783947415.646803:0:7798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1783947415.646852:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1783947415.646870:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783947415.646879:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a400/0x20c3e53e78bb1c67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c6e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.646907:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a400/0x20c3e53e78bb1c67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c6e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947415.646918:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783947415.646920:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b3c85ce6800 from 30 10000000:01000000:2.0:1783947415.646924:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783947415.646948:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1c75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.646956:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1c75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.648308:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1c75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947415.648405:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319870976:0@lo:101: 00000100:00100000:2.0:1783947415.648476:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947415.648519:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb61a7240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947415.648543:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319870976 00000100:00100000:2.0:1783947415.648548:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319870976 00000100:00100000:2.0:1783947415.648584:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783947415.648592:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:5793:x1870604319870976:12345-0@lo:101: 00010000:00010000:2.0:1783947415.648604:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947415.648619:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1c7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1c75 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.648642:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c75 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.649402:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c75 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.649411:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a600, rc 0) 00000100:00100000:2.0:1783947415.650404:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:5793:x1870604319870976:12345-0@lo:101: Request processed in 1807us (1921us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947415.650414:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783947415.657975:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319870976:0@lo:101: 00010000:00010000:3.0:1783947415.658013:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1c75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c7c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947415.658026:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1c75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1c7c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947415.658114:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319871104:0@lo:501: 00000100:00100000:3.0:1783947415.658188:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947415.658313:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319871104 00000100:00100000:1.0:1783947415.658328:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319871104 00000100:00100000:1.0:1783947415.658377:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783947415.658386:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:5793:x1870604319871104:12345-0@lo:501: 00000100:00100000:1.0:1783947415.658667:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:5793:x1870604319871104:12345-0@lo:501: Request processed in 269us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947415.658675:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783947415.659824:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e683c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947415.659862:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319871104:0@lo:501: 00000100:00100000:3.0:1783947415.659913:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319871232:0@lo:503: 00000100:00100000:3.0:1783947415.659975:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947415.660001:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947415.663489:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319871232 00000100:00100000:1.0:1783947415.663505:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319871232 00000100:00100000:1.0:1783947415.663573:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783947415.663584:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:5793:x1870604319871232:12345-0@lo:503: 00000100:00100000:1.0:1783947415.663855:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:5793:x1870604319871232:12345-0@lo:503: Request processed in 273us (3879us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947415.663870:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783947415.664060:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319871232:0@lo:503: 00000100:00100000:3.0:1783947415.664702:0:7801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7801:1870604319871360:0@lo:502: 00000100:00100000:3.0:1783947415.664758:0:7801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947415.664786:0:7801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e683c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947415.664879:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319871360 00000100:00100000:2.0:1783947415.664885:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319871360 00000100:00100000:2.0:1783947415.664923:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783947415.664931:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:7801:x1870604319871360:12345-0@lo:502: 00000100:00100000:2.0:1783947415.665153:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:7801:x1870604319871360:12345-0@lo:502: Request processed in 222us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947415.665161:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783947415.665478:0:7801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7801:1870604319871360:0@lo:502: 00000100:00100000:3.0:1783947415.665528:0:7801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7801:1870604319871488:0@lo:502: 00000100:00100000:3.0:1783947415.665566:0:7801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947415.665587:0:7801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e683c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947415.665641:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319871488 00000100:00100000:2.0:1783947415.665646:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319871488 00000100:00100000:2.0:1783947415.665688:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783947415.665695:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:7801:x1870604319871488:12345-0@lo:502: 00000100:00100000:2.0:1783947415.665852:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:7801:x1870604319871488:12345-0@lo:502: Request processed in 157us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947415.665860:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783947415.665897:0:7801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7801:1870604319871488:0@lo:502: 00000040:00080000:2.0:1783947415.665916:0:7801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1783947415.665986:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1783947415.666007:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783947415.666017:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1c75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c7c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.666029:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c7c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947415.666039:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783947415.666041:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8b3c85ce6800 from 5 10000000:01000000:2.0:1783947415.666044:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783947415.666071:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b400/0x20c3e53e78bb1c83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.666081:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b400/0x20c3e53e78bb1c83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.666092:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b400/0x20c3e53e78bb1c83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947415.666105:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319871616:0@lo:101: 00000100:00100000:2.0:1783947415.666134:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947415.666148:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e06a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947415.666159:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319871616 00000100:00100000:2.0:1783947415.666162:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319871616 00000100:00100000:2.0:1783947415.666192:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783947415.666197:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:5793:x1870604319871616:12345-0@lo:101: 00010000:00010000:2.0:1783947415.666205:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947415.666218:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3ca9d1b200/0x20c3e53e78bb1c8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1c83 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.666265:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3ca9d1b200/0x20c3e53e78bb1c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c83 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.666276:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3ca9d1b200/0x20c3e53e78bb1c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c83 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.666284:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1b200, rc 0) 00000100:00100000:2.0:1783947415.666313:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319871616:12345-0@lo:101: Request processed in 116us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947415.666635:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783947415.666724:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319871616:0@lo:101: 00010000:00010000:2.0:1783947415.666736:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b400/0x20c3e53e78bb1c83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c8a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.666745:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b400/0x20c3e53e78bb1c83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1c8a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947415.666787:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319871744:0@lo:256: 00000100:00100000:2.0:1783947415.666816:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947415.667471:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e06a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783947415.670580:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319871744 00000100:00100000:1.0:1783947415.670596:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319871744 00000100:00100000:1.0:1783947415.670668:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783947415.670679:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319871744:12345-0@lo:256: 20000000:01000000:1.0:1783947415.670705:0:5791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783947415.670726:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783947415.670729:0:5791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1783947415.670858:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319871744:12345-0@lo:256: Request processed in 180us (4040us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947415.670867:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783947415.671396:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319871744:0@lo:256: 10000000:01000000:2.0:1783947415.671474:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783947415.671484:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b400/0x20c3e53e78bb1c83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c8a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.671495:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b400/0x20c3e53e78bb1c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c8a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947415.671514:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783947415.671516:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1783947415.671519:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783947415.671548:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1c91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.671556:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1c91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.671565:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1c91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947415.671582:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319871872:0@lo:101: 00000100:00100000:2.0:1783947415.671620:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947415.671648:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e06a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947415.675536:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319871872 00000100:00100000:3.0:1783947415.675550:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319871872 00000100:00100000:2.0:1783947415.683269:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783947415.683283:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319871872:12345-0@lo:101: 00010000:00010000:2.0:1783947415.683300:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947415.683327:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3ca9d1a800/0x20c3e53e78bb1c98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1c91 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.683354:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3ca9d1a800/0x20c3e53e78bb1c98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c91 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.683364:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3ca9d1a800/0x20c3e53e78bb1c98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c91 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.683373:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a800, rc 0) 00000100:00100000:2.0:1783947415.683469:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319871872:12345-0@lo:101: Request processed in 189us (11848us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947415.683475:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783947415.683528:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319871872:0@lo:101: 00010000:00010000:2.0:1783947415.683545:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1c91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c98 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.683554:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1c91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1c98 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947415.683622:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319872000:0@lo:501: 00000100:00100000:2.0:1783947415.683651:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947415.683689:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e06a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947415.685434:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319872000 00000100:00100000:0.0:1783947415.685445:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319872000 00000100:00100000:0.0:1783947415.685497:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783947415.685506:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319872000:12345-0@lo:501: 00000100:00100000:0.0:1783947415.686178:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319872000:12345-0@lo:501: Request processed in 670us (2522us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947415.686186:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783947415.687402:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319872000:0@lo:501: 00000100:00100000:0.0:1783947415.687472:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319872128:0@lo:503: 00000100:00100000:0.0:1783947415.687528:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947415.687564:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb66f29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947415.687589:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319872128 00000100:00100000:0.0:1783947415.687595:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319872128 00000100:00100000:0.0:1783947415.687640:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783947415.687648:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319872128:12345-0@lo:503: 00000100:00100000:0.0:1783947415.692475:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319872128:12345-0@lo:503: Request processed in 4820us (4940us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947415.692489:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783947415.692569:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319872128:0@lo:503: 00000100:00100000:1.0:1783947415.694301:0:7804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7804:1870604319872256:0@lo:502: 00000100:00100000:1.0:1783947415.694817:0:7804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947415.694861:0:7804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8820d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947415.695151:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319872256 00000100:00100000:0.0:1783947415.695158:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319872256 00000100:00100000:0.0:1783947415.695220:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783947415.695387:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:7804:x1870604319872256:12345-0@lo:502: 00000100:00100000:1.0:1783947415.699909:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:7804:x1870604319872256:12345-0@lo:502: Request processed in 4670us (5083us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947415.699926:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783947415.701753:0:7804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7804:1870604319872256:0@lo:502: 00000020:01000000:0.0:1783947415.701804:0:7804:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783947415.701811:0:7804:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1783947415.701821:0:7804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947415.701824:0:7804:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1783947415.701829:0:7804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783947415.701833:0:7804:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.132@tcp to nid 0x20000c0a8cb84 (192.168.203.132@tcp) 00000020:01000000:0.0:1783947415.701859:0:7804:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783947415.701862:0:7804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783947415.701878:0:7804:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8b3cc18b0000) 00000020:00000080:0.0:1783947415.701901:0:7804:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1783947415.701906:0:7804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783947415.702107:0:7804:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1783947415.702113:0:7804:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1783947415.702121:0:7804:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20c3e53e78bb1ca6 00010000:00080000:0.0:1783947415.702152:0:7804:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b3c8579d000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:1.0:1783947415.704556:0:7804:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1783947415.704885:0:7804:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1783947415.704899:0:7804:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783947415.709088:0:7804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783947415.709479:0:7804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783947415.709530:0:7804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1783947415.709588:0:7804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1783947415.711654:0:7805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783947415.711661:0:7805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1783947415.712313:0:7804:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783947415.712390:0:7804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783947415.712602:0:7804:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783947415.712625:0:7804:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20c3e53e78bb1cad 00000100:00080000:1.0:1783947415.712636:0:7804:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783947415.712642:0:7804:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8b3c8579d000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1783947415.712683:0:7804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3c84f50700 x1870604319872384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783947415.712709:0:7804:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1783947415.712754:0:7804:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947415.712759:0:7804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947415.712761:0:7804:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783947415.712764:0:7804:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947415.712768:0:7804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947415.712769:0:7804:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783947415.712771:0:7804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783947415.712773:0:7804:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783947415.712802:0:7804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f53b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7804:1870604319872512:0@lo:502: 00000100:00100000:1.0:1783947415.712877:0:7804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947415.712913:0:7804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3ca03e6000 going to sleep for 11 seconds 00000100:00100000:0.0:1783947415.712965:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319872384:0@lo:8: 00000100:00100000:0.0:1783947415.713003:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947415.713111:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319872512 00000100:00100000:0.0:1783947415.713116:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319872512 00000100:00100000:0.0:1783947415.713157:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783947415.713176:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:7804:x1870604319872512:12345-0@lo:502: 00000100:00100000:0.0:1783947415.713411:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:7804:x1870604319872512:12345-0@lo:502: Request processed in 245us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947415.713442:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783947415.713483:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83372680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319872640:0@lo:400: 00000100:00100000:0.0:1783947415.713510:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947415.713531:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947415.713537:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319872768:0@lo:400: 00000100:00100000:0.0:1783947415.713557:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947415.713581:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319872896:0@lo:400: 00000100:00100000:0.0:1783947415.713604:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947415.713643:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319872640 00000100:00100000:0.0:1783947415.713647:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319872640 00000100:00100000:0.0:1783947415.713673:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319872768 00000100:00100000:0.0:1783947415.713675:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319872768 00000100:00100000:0.0:1783947415.713693:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319872896 00000100:00100000:0.0:1783947415.713696:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319872896 00000100:00100000:0.0:1783947415.713710:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783947415.713715:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319872640:12345-0@lo:400: 00000100:00100000:0.0:1783947415.713753:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319872640:12345-0@lo:400: Request processed in 38us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947415.713760:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783947415.713782:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783947415.713788:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319872768:12345-0@lo:400: 00000100:00100000:0.0:1783947415.713815:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319872768:12345-0@lo:400: Request processed in 28us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947415.713821:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783947415.713831:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783947415.713836:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319872896:12345-0@lo:400: 00000100:00100000:0.0:1783947415.713863:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319872896:12345-0@lo:400: Request processed in 26us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947415.713869:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1783947415.713887:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783947415.713914:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b85d63100 x1870604319872896/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947415.713926:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319872896:0@lo:400: 00010000:00080000:0.0:1783947415.713951:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b85d60000 x1870604319872768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947415.713959:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319872768:0@lo:400: 00010000:00080000:0.0:1783947415.713968:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c83372680 x1870604319872640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947415.713975:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83372680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319872640:0@lo:400: 00000100:00100000:1.0:1783947415.714202:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319872384 00000100:00100000:1.0:1783947415.714208:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319872384 00000100:00100000:1.0:1783947415.714296:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783947415.714303:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1870604319872384:12345-0@lo:8: 00010000:00080000:1.0:1783947415.714384:0:6590:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:1.0:1783947415.714409:0:6590:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20c3e53e78bb1cb4 00002000:00100000:1.0:1783947415.714447:0:6590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8b3b85d9c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1783947415.714452:0:6590:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1783947415.714456:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1783947415.714571:0:6590:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783947415.714735:0:6590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783947415.714761:0:6590:0:(import.c:65:import_set_state_nolock()) ffff8b3b85d99000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783947415.714811:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1870604319872384:12345-0@lo:8: Request processed in 507us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947415.714817:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783947415.714855:0:7804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f53b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:7804:1870604319872512:0@lo:502: 00000020:01000000:1.0:1783947415.714886:0:7804:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947415.714893:0:7804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947415.714894:0:7804:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783947415.714897:0:7804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1783947415.716932:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1783947415.716964:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783947415.716986:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1c91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c98 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947415.717022:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1c91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c98 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947415.717033:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783947415.717035:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8b3c85974d40 from 1 10000000:01000000:0.0:1783947415.717038:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783947415.717074:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1cbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947415.717083:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1cbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947415.717094:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1cbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947415.717117:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319873024:0@lo:101: 00000100:00100000:0.0:1783947415.717195:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947415.718433:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319873024 00000100:00100000:2.0:1783947415.718444:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319873024 00000100:00100000:2.0:1783947415.718499:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783947415.718509:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319873024:12345-0@lo:101: 00010000:00010000:2.0:1783947415.718524:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947415.718538:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1cc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1cbb expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.718563:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1cc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1cbb expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.718574:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1cc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1cbb expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947415.718583:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1ae00, rc 0) 00000100:00100000:2.0:1783947415.718639:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319873024:12345-0@lo:101: Request processed in 132us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947415.718652:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783947415.718750:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb66f2300 going to sleep for 11 seconds 00000100:00100000:0.0:1783947415.718776:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319873024:0@lo:101: 00010000:00010000:0.0:1783947415.718793:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1cbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1cc2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947415.718803:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1cbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1cc2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947415.718864:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319873152:0@lo:501: 00000100:00100000:0.0:1783947415.718897:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947415.718930:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb66f2300 going to sleep for 11 seconds 00010000:00080000:0.0:1783947415.718963:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c84f50700 x1870604319872384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783947425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947415.718973:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783947415.718980:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783947415.718987:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783947415.718992:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783947415.718995:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3c8579d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783947415.719010:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783947415.719016:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319872384:0@lo:8: 00000100:00100000:2.0:1783947415.719184:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319873152 00000100:00100000:2.0:1783947415.719189:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319873152 00000100:00100000:2.0:1783947415.720061:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783947415.720074:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319873152:12345-0@lo:501: 00000100:00100000:2.0:1783947415.720337:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319873152:12345-0@lo:501: Request processed in 266us (1439us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783947415.720346:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000004:00080000:1.0:1783947415.721219:0:7805:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783947415.721359:0:7805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 230991939146ns, next at 0ns, rc = 0 00000100:00100000:0.0:1783947415.729501:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319873152:0@lo:501: 10000000:01000000:0.0:1783947415.729549:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783947415.729560:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1cbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1cc2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947415.729571:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1cbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1cc2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783947415.827911:0:7806:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1783947415.827945:0:7806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d63100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7806:1870604319873408:0@lo:7: 00000100:00100000:0.0:1783947415.828013:0:7806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947415.828060:0:7806:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb66f2540 going to sleep for 11 seconds 00000004:00080000:0.0:1783947415.828083:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1783947415.828113:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319873280:0@lo:13: 00000100:00100000:0.0:1783947415.828137:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947415.828187:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319873408 00000100:00100000:0.0:1783947415.828194:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319873408 00000100:00100000:2.0:1783947415.828472:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319873280 00000100:00100000:2.0:1783947415.828476:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319873280 00000100:00100000:2.0:1783947415.828515:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947415.828523:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1870604319873280:12345-0@lo:13: 00002000:00000024:2.0:1783947415.828555:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1783947415.828604:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1870604319873280:12345-0@lo:13: Request processed in 82us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947415.828611:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783947415.829580:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947415.829591:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7806:x1870604319873408:12345-0@lo:7: 00000100:00080000:3.0:1783947415.836595:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783947415.836790:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b85d60000 x1870604319873280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947415.836815:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319873280:0@lo:13: 00002000:00080000:0.0:1783947415.846187:0:6592:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1783947415.846196:0:6592:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1783947415.846522:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7806:x1870604319873408:12345-0@lo:7: Request processed in 16930us (18505us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947415.846535:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1783947415.846613:0:7806:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b85d63100 x1870604319873408/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783947431 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947415.846631:0:7806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d63100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7806:1870604319873408:0@lo:7: 00000004:00080000:2.0:1783947415.846644:0:7806:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1783947415.846752:0:7806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7806:1870604319873536:0@lo:5: 00000100:00100000:2.0:1783947415.846785:0:7806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947415.846860:0:7806:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb61a76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947415.846899:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319873536 00000100:00100000:0.0:1783947415.846905:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319873536 00000100:00100000:0.0:1783947415.846978:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783947415.846987:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7806:x1870604319873536:12345-0@lo:5: 00002000:00080000:0.0:1783947415.847201:0:6591:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1783947415.847205:0:6591:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1783947415.847837:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7806:x1870604319873536:12345-0@lo:5: Request processed in 849us (1049us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1783947415.847847:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783947415.847892:0:7806:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c83377480 x1870604319873536/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783947431 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947415.847905:0:7806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7806:1870604319873536:0@lo:5: 00000004:00080000:0.0:1783947415.847916:0:7806:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1783947415.847947:0:7806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d60000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7806:1870604319873664:0@lo:700: 00000100:00100000:0.0:1783947415.847975:0:7806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947415.848340:0:7806:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb66f2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947415.848513:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319873664 00000100:00100000:2.0:1783947415.848520:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319873664 00000100:00100000:2.0:1783947415.848559:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947415.848572:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7806:x1870604319873664:12345-0@lo:700: 00000100:00100000:2.0:1783947415.848607:0:6598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83375180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6598:1870604319873792:0@lo:700: 00000100:00100000:2.0:1783947415.848640:0:6598:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947415.848736:0:6598:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb61a7900 going to sleep for 11 seconds 00000100:00100000:2.0:1783947415.848751:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319873792 00000100:00100000:2.0:1783947415.848754:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319873792 00000100:00100000:2.0:1783947415.848777:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947415.848783:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6598:x1870604319873792:12345-0@lo:700: 00010000:00010000:0.0:1783947415.866134:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:2.0:1783947415.896257:0:5803:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1783947415.902776:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6598:x1870604319873792:12345-0@lo:700: Request processed in 53984us (54127us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947415.902791:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783947415.904550:0:6598:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c83375180 x1870604319873792/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783947431 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947415.904570:0:6598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83375180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6598:1870604319873792:0@lo:700: 40000000:02000000:2.0:1783947415.904583:0:6598:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1783947415.998045:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7806:x1870604319873664:12345-0@lo:700: Request processed in 149465us (150059us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947415.998059:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783947415.998119:0:7806:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b85d60000 x1870604319873664/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783947431 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947415.998136:0:7806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d60000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7806:1870604319873664:0@lo:700: 00000001:00080000:2.0:1783947415.998628:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1783947415.998659:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:3.0:1783947416.054542:0:7806:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1783947416.058652:0:7806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd039500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7806:1870604319873920:0@lo:5: 00000100:00100000:3.0:1783947416.058719:0:7806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947416.058825:0:7806:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e68300 going to sleep for 11 seconds 00000100:00100000:0.0:1783947416.058990:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319873920 00000100:00100000:0.0:1783947416.058998:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319873920 00000100:00100000:0.0:1783947416.059050:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783947416.059059:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7806:x1870604319873920:12345-0@lo:5: 00002000:00080000:2.0:1783947416.067278:0:6592:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1783947416.067299:0:6592:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1783947416.075129:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7806:x1870604319873920:12345-0@lo:5: Request processed in 16063us (16401us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1783947416.075144:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1783947416.077049:0:7806:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd039500 x1870604319873920/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783947432 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947416.077067:0:7806:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1783947416.077086:0:7806:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8b3cbd039500 x1870604319873920/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783947432 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947416.077097:0:7806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd039500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7806:1870604319873920:0@lo:5: 00000004:00080000:3.0:1783947416.077111:0:7806:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:2.0:1783947416.188983:0:7856:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783947416.895443:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947417.915123:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947418.940775:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947419.967150:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947420.730492:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319874048:0@lo:13: 00000100:00100000:0.0:1783947420.730603:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947420.730704:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319874048 00000100:00100000:0.0:1783947420.730713:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319874048 00000100:00100000:0.0:1783947420.730784:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783947420.730794:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319874048:12345-0@lo:13: 00002000:00000024:0.0:1783947420.730841:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947420.730897:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319874048:12345-0@lo:13: Request processed in 104us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947420.730906:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1783947420.730933:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783947420.730977:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b85d61180 x1870604319874048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947420.731000:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319874048:0@lo:13: 00000100:00100000:0.0:1783947420.731332:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83375c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319874304:0@lo:400: 00000100:00100000:0.0:1783947420.731372:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947420.731452:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319874816:0@lo:400: 00000100:00100000:0.0:1783947420.731480:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947420.731523:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947420.731530:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319874432:0@lo:400: 00000100:00100000:0.0:1783947420.731555:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947420.735547:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319874816 00000100:00100000:0.0:1783947420.735569:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319874816 00000100:00100000:0.0:1783947420.735660:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947420.735672:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1870604319874816:12345-0@lo:400: 00000100:00100000:0.0:1783947420.735778:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1870604319874816:12345-0@lo:400: Request processed in 109us (4295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947420.735787:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947420.735829:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319874176:0@lo:400: 00000100:00100000:0.0:1783947420.735882:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947420.735923:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319874688:0@lo:400: 00000100:00100000:0.0:1783947420.735957:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947420.736087:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319874304 00000100:00100000:2.0:1783947420.736094:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319874304 00000100:00100000:2.0:1783947420.736144:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319874432 00000100:00100000:2.0:1783947420.736158:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319874432 00000100:00100000:2.0:1783947420.736189:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783947420.736198:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319874304:12345-0@lo:400: 00000100:00100000:2.0:1783947420.738394:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319874304:12345-0@lo:400: Request processed in 2184us (7007us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947420.738414:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783947420.738483:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783947420.738500:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319874432:12345-0@lo:400: 00000100:00100000:2.0:1783947420.738565:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319874432:12345-0@lo:400: Request processed in 73us (7009us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947420.738572:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783947420.738611:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319874176 00000100:00100000:2.0:1783947420.738622:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319874176 00000100:00100000:2.0:1783947420.738677:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783947420.738684:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319874176:12345-0@lo:400: 00000100:00100000:2.0:1783947420.738720:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319874176:12345-0@lo:400: Request processed in 37us (2838us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947420.738726:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783947420.738906:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319874176:0@lo:400: 00000100:00100000:0.0:1783947420.738929:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947420.738942:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319874560:0@lo:400: 00000100:00100000:0.0:1783947420.738979:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783947420.739014:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947420.739022:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783947420.739056:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c83376300 x1870604319874432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947420.739072:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319874432:0@lo:400: 00010000:00080000:0.0:1783947420.739087:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c83375c00 x1870604319874304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947420.739096:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83375c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319874304:0@lo:400: 00010000:00080000:0.0:1783947420.739124:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c83374000 x1870604319874816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947420.739147:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319874816:0@lo:400: 00000100:00100000:2.0:1783947420.739325:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319874560 00000100:00100000:2.0:1783947420.739331:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319874560 00000100:00100000:2.0:1783947420.739371:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783947420.739379:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319874560:12345-0@lo:400: 00000100:00100000:2.0:1783947420.739471:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319874560:12345-0@lo:400: Request processed in 93us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947420.739479:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783947420.739499:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319874688 00000100:00100000:2.0:1783947420.739503:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319874688 00000100:00100000:2.0:1783947420.739543:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783947420.739548:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319874688:12345-0@lo:400: 00000100:00100000:2.0:1783947420.739581:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319874688:12345-0@lo:400: Request processed in 33us (3624us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947420.739589:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1783947420.739618:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c83377480 x1870604319874560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947420.739628:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319874560:0@lo:400: 00010000:00080000:2.0:1783947420.739639:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c83377b80 x1870604319874688/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947420.739647:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319874688:0@lo:400: 00000100:00080000:0.0:1783947420.739808:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783947420.985970:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947421.244015:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319874944:0@lo:13: 00000100:00100000:0.0:1783947421.244121:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947421.255432:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319874944 00000100:00100000:2.0:1783947421.255453:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319874944 00000100:00100000:2.0:1783947421.256056:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783947421.256070:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1870604319874944:12345-0@lo:13: 00002000:00000024:2.0:1783947421.256123:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947421.256575:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1870604319874944:12345-0@lo:13: Request processed in 412us (12357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947421.256586:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1783947421.265704:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c83377b80 x1870604319874944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947421.265746:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319874944:0@lo:13: 00000001:00080000:0.0:1783947421.377807:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1783947422.021755:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947423.028999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:2.0:1783947423.036631:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947423.048484:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297830528 00000100:00100000:2.0:1783947423.048508:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297830528 00000100:00100000:2.0:1783947423.048578:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00100000:2.0:1783947423.048588:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2352:x1870604297830528:12345-192.168.203.32@tcp:250: 00010000:00080000:2.0:1783947423.048629:0:5790:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from d64dfe14-87c9-4273-a23c-517e593e369d@192.168.203.32@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:2.0:1783947423.048699:0:5790:0:(genops.c:1406:class_connect()) connect: client d64dfe14-87c9-4273-a23c-517e593e369d, cookie 0x20c3e53e78bb1cc9 00000100:00080000:2.0:1783947423.048885:0:5790:0:(import.c:65:import_set_state_nolock()) ffff8b3cbd4d5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947423.049003:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+5:2352:x1870604297830528:12345-192.168.203.32@tcp:250: Request processed in 413us (20020us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947423.049012:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00100000:3.0:1783947423.061546:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947423.061611:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297830656 00000100:00100000:3.0:1783947423.061625:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297830656 00000100:00100000:3.0:1783947423.061693:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 114 00000100:00100000:3.0:1783947423.061705:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+5:5559:x1870604297830656:12345-192.168.203.32@tcp:101: 00010000:00010000:3.0:1783947423.061728:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947423.061751:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c8147c800/0x20c3e53e78bb1cd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aaea6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947423.061788:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c8147c800/0x20c3e53e78bb1cd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaea6 expref: 6 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947423.062263:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c8147c800/0x20c3e53e78bb1cd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaea6 expref: 6 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947423.062311:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147c800, rc 0) 00000100:00100000:3.0:1783947423.062389:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+6:5559:x1870604297830656:12345-192.168.203.32@tcp:101: Request processed in 686us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947423.062399:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 114 00000100:00100000:3.0:1783947423.072972:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947423.073100:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297830784 00000100:00100000:0.0:1783947423.073125:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297830784 00000100:00100000:0.0:1783947423.073204:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 115 00000100:00100000:0.0:1783947423.073217:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+6:5559:x1870604297830784:12345-192.168.203.32@tcp:501: 00000100:00100000:0.0:1783947423.073733:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+6:5559:x1870604297830784:12345-192.168.203.32@tcp:501: Request processed in 517us (774us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783947423.073743:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 115 00000100:00100000:1.0:1783947423.083257:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947423.083406:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297830912 00000100:00100000:1.0:1783947423.083643:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297830912 00000100:00100000:1.0:1783947423.083756:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 116 00000100:00100000:1.0:1783947423.083769:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+6:5559:x1870604297830912:12345-192.168.203.32@tcp:101: 00010000:00010000:1.0:1783947423.083815:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947423.083842:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cad73a600/0x20c3e53e78bb1cd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aaead expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947423.083882:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cad73a600/0x20c3e53e78bb1cd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaead expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947423.083897:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cad73a600/0x20c3e53e78bb1cd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaead expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947423.083914:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a600, rc 0) 00000100:00100000:1.0:1783947423.083999:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+7:5559:x1870604297830912:12345-192.168.203.32@tcp:101: Request processed in 232us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947423.084019:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 116 00000100:00100000:3.0:1783947423.086305:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947423.090205:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297831040 00000100:00100000:2.0:1783947423.090227:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297831040 00000100:00100000:2.0:1783947423.090311:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:2.0:1783947423.090323:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+7:5559:x1870604297831040:12345-192.168.203.32@tcp:501: 00000100:00100000:2.0:1783947423.090778:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+8:5559:x1870604297831040:12345-192.168.203.32@tcp:501: Request processed in 453us (4484us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947423.090789:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:0.0:1783947423.096165:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947423.098279:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297831168 00000100:00100000:2.0:1783947423.098301:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297831168 00000100:00100000:2.0:1783947423.098760:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00100000:2.0:1783947423.098775:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+8:5559:x1870604297831168:12345-192.168.203.32@tcp:503: 00000100:00100000:2.0:1783947423.099322:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+8:5559:x1870604297831168:12345-192.168.203.32@tcp:503: Request processed in 546us (3170us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947423.099333:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00100000:0.0:1783947423.106069:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947423.106161:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297831296 00000100:00100000:3.0:1783947423.106176:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297831296 00000100:00100000:3.0:1783947423.106243:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 119 00000100:00100000:3.0:1783947423.106256:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+8:5577:x1870604297831296:12345-192.168.203.32@tcp:502: 00000100:00100000:3.0:1783947423.106731:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+8:5577:x1870604297831296:12345-192.168.203.32@tcp:502: Request processed in 475us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947423.106741:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 119 00000100:00100000:1.0:1783947423.139954:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947423.140286:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297831424 00000100:00100000:3.0:1783947423.140301:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297831424 00000100:00100000:3.0:1783947423.140373:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 120 00000100:00100000:3.0:1783947423.140385:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+8:5577:x1870604297831424:12345-192.168.203.32@tcp:502: 00000100:00100000:3.0:1783947423.140782:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+8:5577:x1870604297831424:12345-192.168.203.32@tcp:502: Request processed in 397us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947423.140790:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 120 00000100:00100000:0.0:1783947423.148540:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947423.148660:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297831552 00000100:00100000:1.0:1783947423.148670:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297831552 00000100:00100000:1.0:1783947423.148732:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 121 00000100:00100000:1.0:1783947423.148743:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+8:5559:x1870604297831552:12345-192.168.203.32@tcp:101: 00010000:00010000:1.0:1783947423.148761:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947423.148780:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cad73be00/0x20c3e53e78bb1cde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aaed7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947423.148813:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cad73be00/0x20c3e53e78bb1cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaed7 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947423.148826:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cad73be00/0x20c3e53e78bb1cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaed7 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947423.148836:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73be00, rc 0) 00000100:00100000:1.0:1783947423.148907:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+9:5559:x1870604297831552:12345-192.168.203.32@tcp:101: Request processed in 166us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947423.148915:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 121 00000100:00100000:3.0:1783947423.165216:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947423.168158:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297831680 00000100:00100000:0.0:1783947423.168174:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297831680 00000100:00100000:0.0:1783947423.168251:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 122 00000100:00100000:0.0:1783947423.168264:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+9:5559:x1870604297831680:12345-192.168.203.32@tcp:256: 20000000:01000000:0.0:1783947423.168293:0:5790:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783947423.168322:0:5790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783947423.168327:0:5790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783947423.168330:0:5790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783947423.168332:0:5790:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1783947423.171572:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+9:5559:x1870604297831680:12345-192.168.203.32@tcp:256: Request processed in 3299us (6360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947423.171587:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 122 00000100:00100000:2.0:1783947423.175701:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947423.175969:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297831808 00000100:00100000:3.0:1783947423.175983:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297831808 00000100:00100000:3.0:1783947423.176053:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 123 00000100:00100000:3.0:1783947423.176064:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+9:5559:x1870604297831808:12345-192.168.203.32@tcp:101: 00010000:00010000:3.0:1783947423.176108:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947423.176144:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c8147ce00/0x20c3e53e78bb1ce5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aaede expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947423.176180:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c8147ce00/0x20c3e53e78bb1ce5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaede expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947423.176193:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c8147ce00/0x20c3e53e78bb1ce5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaede expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947423.176205:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147ce00, rc 0) 00000100:00100000:3.0:1783947423.176412:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+10:5559:x1870604297831808:12345-192.168.203.32@tcp:101: Request processed in 348us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947423.176516:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 123 00000100:00100000:0.0:1783947423.186280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947423.186485:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297831936 00000100:00100000:2.0:1783947423.186504:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297831936 00000100:00100000:2.0:1783947423.186593:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 124 00000100:00100000:2.0:1783947423.186607:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+10:5559:x1870604297831936:12345-192.168.203.32@tcp:501: 00000100:00100000:2.0:1783947423.187060:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+10:5559:x1870604297831936:12345-192.168.203.32@tcp:501: Request processed in 456us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947423.187081:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 124 00000100:00100000:1.0:1783947423.192810:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947423.193969:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297832064 00000100:00100000:0.0:1783947423.193983:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297832064 00000100:00100000:0.0:1783947423.194061:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 125 00000100:00100000:0.0:1783947423.194073:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+10:5559:x1870604297832064:12345-192.168.203.32@tcp:503: 00000100:00100000:0.0:1783947423.194487:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+10:5559:x1870604297832064:12345-192.168.203.32@tcp:503: Request processed in 415us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947423.194495:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 125 00000100:00100000:2.0:1783947423.199400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947423.200057:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297832192 00000100:00100000:0.0:1783947423.200073:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297832192 00000100:00100000:0.0:1783947423.200156:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 126 00000100:00100000:0.0:1783947423.200166:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+10:5582:x1870604297832192:12345-192.168.203.32@tcp:502: 00000100:00100000:0.0:1783947423.200487:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+10:5582:x1870604297832192:12345-192.168.203.32@tcp:502: Request processed in 321us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947423.200495:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 126 00000100:00100000:0.0:1783947423.206694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947423.209900:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297832320 00000100:00100000:2.0:1783947423.209923:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297832320 00000100:00100000:2.0:1783947423.210013:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 127 00000100:00100000:2.0:1783947423.210025:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+10:5582:x1870604297832320:12345-192.168.203.32@tcp:502: 00000100:00100000:2.0:1783947423.210385:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+10:5582:x1870604297832320:12345-192.168.203.32@tcp:502: Request processed in 359us (3698us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947423.210393:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 127 00000100:00100000:3.0:1783947423.221279:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947423.222512:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297832448 00000100:00100000:1.0:1783947423.222531:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297832448 00000100:00100000:1.0:1783947423.222599:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1783947423.222628:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1870604297832448:12345-192.168.203.32@tcp:38: 00010000:00080000:1.0:1783947423.222669:0:5795:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1783947423.222733:0:5795:0:(genops.c:1406:class_connect()) connect: client d1ed966c-3190-4795-821d-ae5dca7b5f51, cookie 0x20c3e53e78bb1cec 00000004:00100000:1.0:1783947423.222776:0:5795:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1783947423.222786:0:5795:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1783947423.272036:0:5795:0:(import.c:65:import_set_state_nolock()) ffff8b3b8410e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947423.272169:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2352:x1870604297832448:12345-192.168.203.32@tcp:38: Request processed in 49540us (50913us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947423.272184:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00010000:00010000:0.0:1783947424.057782:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947424.276225:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947424.276756:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947424.277075:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297832576 00000100:00100000:0.0:1783947424.277089:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297832576 00000100:00100000:0.0:1783947424.277194:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297832704 00000100:00100000:0.0:1783947424.277216:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297832704 00000100:00100000:0.0:1783947424.277251:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00080000:2.0:1783947424.277346:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947424.277389:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:2.0:1783947424.277401:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:5559:x1870604297832704:12345-192.168.203.32@tcp:41: 00000004:00000024:2.0:1783947424.277497:0:5795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783947424.277590:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:5559:x1870604297832704:12345-192.168.203.32@tcp:41: Request processed in 191us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947424.277597:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:0.0:1783947424.278117:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:0:x1870604297832576:12345-192.168.203.32@tcp:41: 00000004:00000024:0.0:1783947424.278141:0:5798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783947424.278190:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:0:x1870604297832576:12345-192.168.203.32@tcp:41: Request processed in 929us (1982us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947424.278197:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:3.0:1783947424.279722:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947424.279816:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297832832 00000100:00100000:2.0:1783947424.279829:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297832832 00000100:00100000:2.0:1783947424.279897:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:2.0:1783947424.279984:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:5559:x1870604297832832:12345-192.168.203.32@tcp:40: 00000100:00100000:2.0:1783947424.280088:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:5559:x1870604297832832:12345-192.168.203.32@tcp:40: Request processed in 181us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947424.280158:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:2.0:1783947424.285867:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947424.285956:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947424.286000:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947424.286062:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947424.286124:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297832960 00000100:00100000:2.0:1783947424.286137:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297832960 00000100:00100000:2.0:1783947424.286181:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297833088 00000100:00100000:2.0:1783947424.286185:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297833088 00000100:00100000:2.0:1783947424.286202:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:2.0:1783947424.286212:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1870604297832960:12345-192.168.203.32@tcp:8: 00010000:00080000:2.0:1783947424.286256:0:6592:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:2.0:1783947424.286296:0:6592:0:(genops.c:1406:class_connect()) connect: client d1ed966c-3190-4795-821d-ae5dca7b5f51, cookie 0x20c3e53e78bb1cf3 00002000:00100000:2.0:1783947424.286312:0:6592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d1ed966c-3190-4795-821d-ae5dca7b5f51/ffff8b3cbd4d4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783947424.286345:0:6592:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783947424.286838:0:6592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783947424.286882:0:6592:0:(import.c:65:import_set_state_nolock()) ffff8b3cbd4d3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947424.286982:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2352:x1870604297832960:12345-192.168.203.32@tcp:8: Request processed in 770us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947424.286993:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:2.0:1783947424.287028:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:2.0:1783947424.287034:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1870604297833088:12345-192.168.203.32@tcp:8: 00010000:00080000:2.0:1783947424.287056:0:6592:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:2.0:1783947424.287078:0:6592:0:(genops.c:1406:class_connect()) connect: client d1ed966c-3190-4795-821d-ae5dca7b5f51, cookie 0x20c3e53e78bb1cfa 00002000:00100000:2.0:1783947424.287088:0:6592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d1ed966c-3190-4795-821d-ae5dca7b5f51/ffff8b3cbd4d4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783947424.287121:0:6592:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783947424.287376:0:6592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783947424.287410:0:6592:0:(import.c:65:import_set_state_nolock()) ffff8b3cbd4d0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947424.287480:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2352:x1870604297833088:12345-192.168.203.32@tcp:8: Request processed in 444us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947424.287493:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:3.0:1783947424.287844:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297833344 00000100:00100000:3.0:1783947424.287854:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297833344 00000100:00100000:3.0:1783947424.287917:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 128 00000100:00100000:3.0:1783947424.287928:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+10:2356:x1870604297833344:12345-192.168.203.32@tcp:400: 00000100:00100000:3.0:1783947424.287967:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+10:2356:x1870604297833344:12345-192.168.203.32@tcp:400: Request processed in 41us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947424.287975:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 128 00000100:00100000:0.0:1783947424.288456:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297833216 00000100:00100000:0.0:1783947424.288463:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297833216 00000100:00100000:0.0:1783947424.288502:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:0.0:1783947424.288510:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:5559:x1870604297833216:12345-192.168.203.32@tcp:33: 00000004:00080000:0.0:1783947424.320477:0:5799:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 31887us 00000004:00200000:0.0:1783947424.356668:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1783947424.356880:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:5559:x1870604297833216:12345-192.168.203.32@tcp:33: Request processed in 68360us (71019us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947424.356893:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:2.0:1783947424.587676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947424.587848:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297833472 00000100:00100000:0.0:1783947424.587862:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297833472 00000100:00100000:0.0:1783947424.587950:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:0.0:1783947424.587963:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:5599:x1870604297833472:12345-192.168.203.32@tcp:101: 00010000:00010000:0.0:1783947424.587996:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947424.588737:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c80030400/0x20c3e53e78bb1d01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aaf08 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947424.588831:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c80030e00/0x20c3e53e78bb1d08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947424.588864:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c80030e00/0x20c3e53e78bb1d08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947424.588879:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c80030e00/0x20c3e53e78bb1d08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947424.589121:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1783947424.589126:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783947424.589562:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c80030e00/0x20c3e53e78bb1d08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947424.589597:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c80030400/0x20c3e53e78bb1d01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf08 expref: 8 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947424.589614:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c80030e00/0x20c3e53e78bb1d08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf08 expref: 7 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947424.589622:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c8281be00) 00010000:00010000:0.0:1783947424.589625:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947424.589628:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c80030e00, rc 0) 00000100:00100000:0.0:1783947424.589702:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:5599:x1870604297833472:12345-192.168.203.32@tcp:101: Request processed in 1742us (2045us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947424.589711:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00010000:00010000:2.0:1783947425.081871:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947425.852090:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319875328:0@lo:400: 00000100:00100000:0.0:1783947425.852196:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947425.852281:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947425.852288:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319875456:0@lo:400: 00000100:00100000:0.0:1783947425.852316:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947425.853017:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319875072:0@lo:400: 00000100:00100000:2.0:1783947425.853059:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947425.853089:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319875584:0@lo:400: 00000100:00100000:2.0:1783947425.853126:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947425.853150:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783947425.853156:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319875200:0@lo:400: 00000100:00100000:2.0:1783947425.853179:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947425.853197:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83372680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319875712:0@lo:400: 00000100:00100000:2.0:1783947425.853242:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319875328 00000100:00100000:2.0:1783947425.853260:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319875328 00000100:00100000:2.0:1783947425.853311:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319875584 00000100:00100000:2.0:1783947425.853313:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319875584 00000100:00100000:2.0:1783947425.853337:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319875200 00000100:00100000:2.0:1783947425.853339:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319875200 00000100:00100000:2.0:1783947425.853353:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783947425.853360:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319875328:12345-0@lo:400: 00000100:00100000:2.0:1783947425.853409:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319875328:12345-0@lo:400: Request processed in 49us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947425.853433:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783947425.853450:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783947425.853457:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319875584:12345-0@lo:400: 00000100:00100000:2.0:1783947425.853502:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319875584:12345-0@lo:400: Request processed in 46us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947425.853508:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783947425.853535:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783947425.853542:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319875200:12345-0@lo:400: 00000100:00100000:2.0:1783947425.853568:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319875200:12345-0@lo:400: Request processed in 28us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947425.853574:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1783947425.853593:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947425.853641:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319875072 00000100:00100000:2.0:1783947425.853644:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319875072 00000100:00100000:2.0:1783947425.853678:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783947425.853684:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319875072:12345-0@lo:400: 00000100:00100000:2.0:1783947425.853714:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319875072:12345-0@lo:400: Request processed in 30us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947425.853719:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783947425.854082:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319875328:0@lo:400: 00000100:00100000:2.0:1783947425.856774:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947425.859115:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319875840:0@lo:13: 00000100:00100000:0.0:1783947425.859188:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947425.859315:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319875840 00000100:00100000:3.0:1783947425.859331:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319875840 00000100:00100000:3.0:1783947425.859392:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783947425.859401:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319875840:12345-0@lo:13: 00002000:00000024:3.0:1783947425.859467:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783947425.859514:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319875840:12345-0@lo:13: Request processed in 114us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947425.859536:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1783947425.859578:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd03b480 x1870604319875840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947425.859596:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319875840:0@lo:13: 00000100:00080000:0.0:1783947425.859904:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947425.860604:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319875072:0@lo:400: 00000100:00100000:2.0:1783947425.860621:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319875584:0@lo:400: 00000100:00100000:2.0:1783947425.860645:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319875200:0@lo:400: 00000100:00100000:1.0:1783947425.869479:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319875456 00000100:00100000:1.0:1783947425.869495:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319875456 00000100:00100000:1.0:1783947425.869593:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319875712 00000100:00100000:1.0:1783947425.869597:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319875712 00000100:00100000:1.0:1783947425.869641:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783947425.869651:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319875456:12345-0@lo:400: 00000100:00080000:3.0:1783947425.870009:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947425.871334:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319875456:12345-0@lo:400: Request processed in 1670us (19001us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947425.871347:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783947425.871378:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783947425.871389:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319875712:12345-0@lo:400: 00000100:00100000:1.0:1783947425.871446:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319875712:12345-0@lo:400: Request processed in 60us (14679us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947425.871458:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1783947425.871716:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b85d60000 x1870604319875456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947425.871733:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319875456:0@lo:400: 00010000:00080000:2.0:1783947425.872144:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c83372680 x1870604319875712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947425.872155:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1783947425.872169:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83372680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319875712:0@lo:400: 00010000:00010000:0.0:1783947426.106090:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947426.361952:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319875968:0@lo:13: 00000100:00100000:0.0:1783947426.362021:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947426.362208:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319875968 00000100:00100000:2.0:1783947426.362224:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319875968 00000100:00100000:2.0:1783947426.362278:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783947426.362287:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319875968:12345-0@lo:13: 00002000:00000024:2.0:1783947426.362320:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947426.363061:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319875968:12345-0@lo:13: Request processed in 771us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947426.363071:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1783947426.363135:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c83374000 x1870604319875968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947426.363155:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319875968:0@lo:13: 00000001:00100000:0.0:1783947426.395402:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d1ed966c-3190-4795-821d-ae5dca7b5f51 00000100:00100000:0.0:1783947426.749516:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947426.749621:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297833600 00000100:00100000:2.0:1783947426.749630:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297833600 00000100:00100000:2.0:1783947426.749751:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:2.0:1783947426.749761:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:5651:x1870604297833600:12345-192.168.203.32@tcp:41: 00000004:00000024:2.0:1783947426.749803:0:5795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783947426.749876:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:5651:x1870604297833600:12345-192.168.203.32@tcp:41: Request processed in 116us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947426.749884:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00080000:3.0:1783947426.757031:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947426.764817:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947426.765007:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297833728 00000100:00100000:2.0:1783947426.765019:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297833728 00000100:00100000:2.0:1783947426.765103:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:2.0:1783947426.765113:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:5651:x1870604297833728:12345-192.168.203.32@tcp:13: 00002000:00000024:2.0:1783947426.765138:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1783947426.765290:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947426.765655:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:5651:x1870604297833728:12345-192.168.203.32@tcp:13: Request processed in 540us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947426.765665:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1783947426.779051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947426.780980:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297833856 00000100:00100000:2.0:1783947426.780994:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297833856 00000100:00100000:2.0:1783947426.781160:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:2.0:1783947426.781170:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:5651:x1870604297833856:12345-192.168.203.32@tcp:13: 00002000:00000024:2.0:1783947426.781212:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947426.781303:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:5651:x1870604297833856:12345-192.168.203.32@tcp:13: Request processed in 134us (2261us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947426.781311:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00080000:3.0:1783947426.785156:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783947427.129705:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947428.155702:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783947428.529387:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d1ed966c-3190-4795-821d-ae5dca7b5f51 00000001:00100000:0.0:1783947429.013222:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d1ed966c-3190-4795-821d-ae5dca7b5f51 00010000:00010000:0.0:1783947429.177893:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947429.637120:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947429.637177:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297833984 00000100:00100000:0.0:1783947429.637183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947429.637193:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297833984 00000100:00100000:0.0:1783947429.637232:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947429.637282:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 130 00000100:00100000:0.0:1783947429.637283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947429.637300:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+10:2354:x1870604297833984:12345-192.168.203.32@tcp:400: 00000100:00100000:0.0:1783947429.637318:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297834112 00000100:00100000:0.0:1783947429.637323:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297834112 00000100:00100000:0.0:1783947429.637382:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:0.0:1783947429.637393:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297834112:12345-192.168.203.32@tcp:400: 00000100:00100000:2.0:1783947429.637404:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+10:2354:x1870604297833984:12345-192.168.203.32@tcp:400: Request processed in 107us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947429.637414:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 130 00000100:00100000:0.0:1783947429.637466:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297834112:12345-192.168.203.32@tcp:400: Request processed in 76us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947429.637500:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:0.0:1783947429.637539:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297834240 00000100:00100000:0.0:1783947429.637543:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297834240 00000100:00100000:0.0:1783947429.637581:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297834368 00000100:00100000:0.0:1783947429.637585:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297834368 00000100:00100000:2.0:1783947429.637610:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:2.0:1783947429.637620:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297834240:12345-192.168.203.32@tcp:400: 00000100:00100000:2.0:1783947429.637654:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297834240:12345-192.168.203.32@tcp:400: Request processed in 37us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947429.637672:0:6592:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1783947429.637686:0:6592:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:1.0:1783947429.640739:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947429.640765:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947429.640771:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947429.642442:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:0.0:1783947429.642487:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297834368:12345-192.168.203.32@tcp:400: 00000100:00100000:2.0:1783947429.642493:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:0.0:1783947429.644228:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297834368:12345-192.168.203.32@tcp:400: Request processed in 1692us (6872us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947429.644245:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000001:02000400:0.0:1783947429.788263:0:8164:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1783947430.203442:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947430.969810:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319876352:0@lo:400: 00000100:00100000:0.0:1783947430.969911:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947430.969993:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319876864:0@lo:400: 00000100:00100000:0.0:1783947430.970032:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947430.970084:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947430.970091:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319876480:0@lo:400: 00000100:00100000:0.0:1783947430.970130:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947430.970175:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319876352 00000100:00100000:0.0:1783947430.970183:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319876352 00000100:00100000:0.0:1783947430.970242:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319876480 00000100:00100000:0.0:1783947430.970246:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319876480 00000100:00100000:2.0:1783947430.970249:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319876096:0@lo:13: 00000100:00100000:0.0:1783947430.970289:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783947430.970295:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947430.970302:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319876352:12345-0@lo:400: 00000100:00100000:2.0:1783947430.970323:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319876608:0@lo:400: 00000100:00100000:2.0:1783947430.970350:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947430.970373:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783947430.970379:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319876352:12345-0@lo:400: Request processed in 78us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947430.970383:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319876224:0@lo:400: 00000100:00100000:0.0:1783947430.970406:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783947430.970447:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947430.970461:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783947430.970471:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319876480:12345-0@lo:400: 00000100:00100000:2.0:1783947430.970480:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319876736:0@lo:400: 00000100:00100000:0.0:1783947430.970516:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319876480:12345-0@lo:400: Request processed in 46us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947430.970525:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947430.970529:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947430.970576:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319876096 00000100:00100000:2.0:1783947430.970581:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319876096 00000100:00100000:2.0:1783947430.970619:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783947430.970626:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319876096:12345-0@lo:13: 00002000:00000024:2.0:1783947430.970663:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947430.970703:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319876096:12345-0@lo:13: Request processed in 78us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947430.970710:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783947430.970732:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319876864 00000100:00100000:2.0:1783947430.970736:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319876864 00000100:00100000:2.0:1783947430.970765:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319876608 00000100:00100000:2.0:1783947430.970768:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319876608 00000100:00100000:2.0:1783947430.970786:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783947430.970792:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319876864:12345-0@lo:400: 00000100:00100000:2.0:1783947430.970823:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319876864:12345-0@lo:400: Request processed in 32us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947430.970829:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783947430.970840:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783947430.970845:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319876608:12345-0@lo:400: 00000100:00100000:2.0:1783947430.970868:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319876608:12345-0@lo:400: Request processed in 22us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947430.970875:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783947430.970890:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319876224 00000100:00100000:2.0:1783947430.970894:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319876224 00000100:00100000:2.0:1783947430.970918:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783947430.970924:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319876224:12345-0@lo:400: 00000100:00100000:2.0:1783947430.970963:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319876224:12345-0@lo:400: Request processed in 39us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947430.970969:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783947430.971017:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319876224:0@lo:400: 00010000:00080000:2.0:1783947430.971046:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd039500 x1870604319876096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947430.971072:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319876096:0@lo:13: 00010000:00080000:2.0:1783947430.971083:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cb6aeed80 x1870604319876608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947430.971091:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319876608:0@lo:400: 00000100:00100000:1.0:1783947430.971244:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319876736 00000100:00100000:1.0:1783947430.971249:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319876736 00000100:00100000:1.0:1783947430.971275:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783947430.971282:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319876736:12345-0@lo:400: 00000100:00100000:1.0:1783947430.971323:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319876736:12345-0@lo:400: Request processed in 42us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947430.971337:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1783947430.971356:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947430.971361:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947430.971364:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947430.971923:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319876480:0@lo:400: 00000100:00100000:0.0:1783947430.971939:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319876352:0@lo:400: 00010000:00080000:0.0:1783947430.971951:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cb6aef100 x1870604319876864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947430.971961:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319876864:0@lo:400: 00000100:00100000:2.0:1783947430.972297:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319876736:0@lo:400: 00010000:00010000:0.0:1783947431.227590:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947431.485741:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319876992:0@lo:13: 00000100:00100000:0.0:1783947431.485838:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947431.488439:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319876992 00000100:00100000:0.0:1783947431.488463:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319876992 00000100:00100000:0.0:1783947431.488547:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783947431.488560:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319876992:12345-0@lo:13: 00002000:00000024:0.0:1783947431.488613:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947431.489375:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319876992:12345-0@lo:13: Request processed in 813us (3531us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947431.489386:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1783947431.489490:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cb6aef100 x1870604319876992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947431.489550:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319876992:0@lo:13: 00010000:00010000:0.0:1783947432.252302:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947433.273694:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783947433.921923:0:8313:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde5a25fa0 20000000:00000080:2.0:1783947433.921941:0:8313:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b3cbd9f2400 uarg=0000000000000000 20000000:01000000:2.0:1783947433.921975:0:8313:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1783947433.921978:0:8313:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1783947433.921980:0:8313:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783947433.921985:0:8313:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783947433.921990:0:8313:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1783947433.922004:0:8313:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783947433.922006:0:8313:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1783947433.922237:0:8313:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783947433.922240:0:8313:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783947433.937947:0:8314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1783947433.945965:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1783947433.946029:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1783947433.946079:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1783947433.946098:0:8313:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1783947433.946100:0:8313:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783947433.947205:0:8315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1783947433.947656:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1783947433.947881:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1783947433.947927:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1783947433.947943:0:8313:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783947433.947945:0:8313:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1783947433.950693:0:8316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1783947433.951412:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1783947433.951509:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1783947433.951564:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1783947433.951580:0:8313:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1783947433.951583:0:8313:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783947433.952667:0:8317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1783947433.953382:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1783947433.953546:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1783947433.953590:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1783947433.953609:0:8313:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783947433.953629:0:8313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b3cad73bc00/0x20c3e53e78bb1d0f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.953650:0:8313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3ca9d1a400/0x20c3e53e78bb1c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c05 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.953658:0:8313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3c8147d800/0x20c3e53e78bb1c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c2f expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.953663:0:8313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3cad73b400/0x20c3e53e78bb1c60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c59 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.953669:0:8313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3c80030000/0x20c3e53e78bb1c6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c67 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.953683:0:8313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1c7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c75 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.953690:0:8313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3ca9d1a800/0x20c3e53e78bb1c98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c91 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.953696:0:8313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1cc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1cbb expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.954277:0:8313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3c8147c800/0x20c3e53e78bb1cd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaea6 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.954293:0:8313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3cad73a600/0x20c3e53e78bb1cd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaead expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.954301:0:8313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b3cad73bc00/0x20c3e53e78bb1d0f lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.954345:0:8313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3cad73a600/0x20c3e53e78bb1cd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaead expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.954360:0:8313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b3cad73a600/0x20c3e53e78bb1cd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaead expref: 9 pid: 5790 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947433.954376:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f53b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1870604319877120:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947433.954520:0:8313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3c8147c800/0x20c3e53e78bb1cd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaea6 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.954530:0:8313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b3c8147c800/0x20c3e53e78bb1cd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaea6 expref: 9 pid: 5791 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947433.954548:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f52d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1870604319877248:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947433.954582:0:8313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1cc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1cbb expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.954590:0:8313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1cc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1cbb expref: 18 pid: 5791 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947433.954600:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1870604319877376:0@lo:104: 00000100:00100000:1.0:1783947433.954640:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783947433.954673:0:8313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3ca9d1a800/0x20c3e53e78bb1c98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1c91 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.954681:0:8313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3ca9d1a800/0x20c3e53e78bb1c98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c91 expref: 18 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947433.954689:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1870604319877504:0@lo:104: 00000100:00100000:0.0:1783947433.955224:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319877376 00000100:00100000:0.0:1783947433.955233:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319877376 00000100:00100000:0.0:1783947433.955285:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783947433.955295:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:8313:x1870604319877376:12345-0@lo:104: 00010000:00010000:0.0:1783947433.955308:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1cbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1cc2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947433.955359:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783947433.955364:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:8313:x1870604319877376:12345-0@lo:104: Request processed in 72us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947433.955372:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1783947433.955395:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947433.955400:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1cbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1cc2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947433.955407:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c80030600 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:0.0:1783947433.955411:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1cbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1cc2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947433.955451:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1cbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1cc2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947433.955459:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1cbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1cc2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947433.955464:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783947433.955492:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1cbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1cc2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947433.955498:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783947433.955521:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1cbb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1cc2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947433.955529:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1cbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1cc2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947433.955543:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947433.955544:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947433.955546:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947433.955563:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319877632:0@lo:103: 00000100:00100000:0.0:1783947433.955593:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947433.955943:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783947433.955990:0:8313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1c75 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.956000:0:8313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1c7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c75 expref: 18 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947433.956009:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1870604319877760:0@lo:104: 00010000:00010000:1.0:1783947433.956048:0:8313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3c80030000/0x20c3e53e78bb1c6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1c67 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.956056:0:8313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3c80030000/0x20c3e53e78bb1c6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c67 expref: 18 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947433.956071:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1870604319877888:0@lo:104: 00010000:00010000:1.0:1783947433.956098:0:8313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3cad73b400/0x20c3e53e78bb1c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1c59 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.956107:0:8313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3cad73b400/0x20c3e53e78bb1c60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c59 expref: 18 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947433.956114:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1870604319878016:0@lo:104: 00010000:00010000:1.0:1783947433.956133:0:8313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3c8147d800/0x20c3e53e78bb1c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1c2f expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.956140:0:8313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3c8147d800/0x20c3e53e78bb1c36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c2f expref: 18 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947433.956147:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f53800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1870604319878144:0@lo:104: 00010000:00010000:1.0:1783947433.956169:0:8313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3ca9d1a400/0x20c3e53e78bb1c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1c05 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.956176:0:8313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3ca9d1a400/0x20c3e53e78bb1c0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c05 expref: 18 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947433.956182:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1870604319878272:0@lo:104: 00000100:00100000:3.0:1783947433.956357:0:5780:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783947433.956377:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947433.956405:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947433.956449:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947433.956460:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947433.956471:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319877504 00000100:00100000:3.0:1783947433.956476:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319877504 00000100:00100000:3.0:1783947433.956504:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319877760 00000100:00100000:3.0:1783947433.956507:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319877760 00000100:00100000:3.0:1783947433.956529:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319877888 00000100:00100000:3.0:1783947433.956532:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319877888 00000100:00100000:3.0:1783947433.956540:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319878016 00000100:00100000:3.0:1783947433.956542:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319878016 00000100:00100000:3.0:1783947433.956550:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319878144 00000100:00100000:3.0:1783947433.956552:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319878144 00000100:00100000:3.0:1783947433.956563:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783947433.956571:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b8418bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+7:8313:x1870604319877504:12345-0@lo:104: 00010000:00010000:3.0:1783947433.956580:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1c91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1c98 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.956621:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783947433.956627:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b8418bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+7:8313:x1870604319877504:12345-0@lo:104: Request processed in 58us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947433.956632:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783947433.956664:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783947433.956670:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd039500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+6:8313:x1870604319877760:12345-0@lo:104: 00010000:00010000:3.0:1783947433.956677:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1c7c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.956720:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783947433.956725:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd039500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+6:8313:x1870604319877760:12345-0@lo:104: Request processed in 56us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947433.956731:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783947433.956744:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783947433.956750:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+5:8313:x1870604319877888:12345-0@lo:104: 00010000:00010000:3.0:1783947433.956758:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a400/0x20c3e53e78bb1c67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1c6e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.956888:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783947433.956893:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+5:8313:x1870604319877888:12345-0@lo:104: Request processed in 144us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947433.956899:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783947433.956911:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783947433.956918:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+4:8313:x1870604319878016:12345-0@lo:104: 00010000:00010000:3.0:1783947433.956925:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ae00/0x20c3e53e78bb1c59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1c60 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.956950:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1783947433.956954:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+4:8313:x1870604319878016:12345-0@lo:104: Request processed in 38us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947433.956958:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783947433.956969:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783947433.956974:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:8313:x1870604319878144:12345-0@lo:104: 00010000:00010000:3.0:1783947433.956981:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a200/0x20c3e53e78bb1c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1c36 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957108:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1783947433.957114:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:8313:x1870604319878144:12345-0@lo:104: Request processed in 139us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947433.957120:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783947433.957142:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319877632 00000100:00100000:3.0:1783947433.957147:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319877632 00010000:00010000:3.0:1783947433.957165:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1cc2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1cbb expref: 19 pid: 5791 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947433.957199:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783947433.957205:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319877632:12345-0@lo:103: 00010000:00010000:3.0:1783947433.957214:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947433.957219:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1cc2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1cbb expref: 19 pid: 5791 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957228:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1cc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1cbb expref: 19 pid: 5791 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957246:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947433.957275:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319877632:12345-0@lo:103: Request processed in 70us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947433.957281:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1783947433.957300:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783947433.957306:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1c91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1c98 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957313:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1aa00 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:3.0:1783947433.957317:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1c91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1c98 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957325:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1c98 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947433.957331:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1c98 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947433.957336:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783947433.957367:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1c91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c98 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957373:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947433.957386:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1c91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c98 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957393:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1aa00/0x20c3e53e78bb1c91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c98 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957406:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783947433.957409:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1c7c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957415:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a000 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:3.0:1783947433.957436:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1c7c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957443:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1c7c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947433.957449:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1c7c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947433.957454:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783947433.957465:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1c75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c7c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957470:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947433.957483:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1c75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c7c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957499:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb1c75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c7c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957507:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783947433.957510:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a400/0x20c3e53e78bb1c67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1c6e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957515:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a400 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:3.0:1783947433.957518:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a400/0x20c3e53e78bb1c67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1c6e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957525:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a400/0x20c3e53e78bb1c67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1c6e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947433.957531:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a400/0x20c3e53e78bb1c67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1c6e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947433.957535:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783947433.957547:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a400/0x20c3e53e78bb1c67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c6e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957553:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947433.957558:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a400/0x20c3e53e78bb1c67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c6e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957564:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a400/0x20c3e53e78bb1c67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c6e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957572:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947433.957580:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ae00/0x20c3e53e78bb1c59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1c60 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957586:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73ae00 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:3.0:1783947433.957589:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ae00/0x20c3e53e78bb1c59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1c60 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957596:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ae00/0x20c3e53e78bb1c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1c60 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947433.957601:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ae00/0x20c3e53e78bb1c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1c60 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947433.957605:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783947433.957617:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ae00/0x20c3e53e78bb1c59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c60 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957622:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947433.957627:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ae00/0x20c3e53e78bb1c59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c60 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957634:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ae00/0x20c3e53e78bb1c59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c60 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957642:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947433.957645:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a200/0x20c3e53e78bb1c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1c36 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957651:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a200 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:3.0:1783947433.957653:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a200/0x20c3e53e78bb1c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1c36 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957669:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a200/0x20c3e53e78bb1c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1c36 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947433.957676:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a200/0x20c3e53e78bb1c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1c36 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947433.957682:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783947433.957693:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a200/0x20c3e53e78bb1c2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c36 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957700:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947433.957704:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a200/0x20c3e53e78bb1c2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c36 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957717:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a200/0x20c3e53e78bb1c2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c36 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.957725:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947433.957727:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947433.957728:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947433.957747:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319878528:0@lo:103: 00000100:00100000:1.0:1783947433.958373:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947433.958471:0:8313:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad698f00 going to sleep for 11 seconds 00010000:00010000:1.0:1783947433.958495:0:8313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3ca9d1ae00/0x20c3e53e78bb1cc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1cbb expref: 18 pid: 5791 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947433.958507:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1870604319877376:0@lo:104: 00000100:00100000:1.0:1783947433.958528:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1870604319877504:0@lo:104: 00000100:00100000:1.0:1783947433.958536:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1870604319877760:0@lo:104: 00000100:00100000:1.0:1783947433.958542:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1870604319877888:0@lo:104: 00000100:00100000:1.0:1783947433.958550:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1870604319878016:0@lo:104: 00000100:00100000:1.0:1783947433.958557:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f53800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1870604319878144:0@lo:104: 00000100:00100000:3.0:1783947433.958646:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947433.958677:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947433.958684:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319878656:0@lo:103: 00000100:00100000:3.0:1783947433.958720:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947433.958935:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319878400:0@lo:103: 00000100:00100000:3.0:1783947433.958960:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947433.959015:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319878272 00000100:00100000:2.0:1783947433.959022:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319878272 00000100:00100000:3.0:1783947433.959241:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319878912:0@lo:103: 00000100:00100000:3.0:1783947433.959271:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947433.959330:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319878528 00000100:00100000:0.0:1783947433.959334:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319878528 00010000:00010000:0.0:1783947433.959361:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1c7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c75 expref: 18 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947433.959381:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319878656 00000100:00100000:0.0:1783947433.959384:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319878656 00010000:00010000:0.0:1783947433.959404:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3c80030000/0x20c3e53e78bb1c6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c67 expref: 19 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947433.959433:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319878400 00000100:00100000:0.0:1783947433.959436:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319878400 00010000:00010000:0.0:1783947433.959448:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3ca9d1a800/0x20c3e53e78bb1c98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c91 expref: 20 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947433.959461:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783947433.959468:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+20:3311:x1870604319878528:12345-0@lo:103: 00010000:00010000:0.0:1783947433.959479:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947433.959484:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1c7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c75 expref: 20 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947433.959493:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c75 expref: 20 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947433.959508:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb1c7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1c75 expref: 20 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947433.959521:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947433.959557:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3311:x1870604319878528:12345-0@lo:103: Request processed in 89us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947433.959563:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783947433.959579:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783947433.959585:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:3311:x1870604319878656:12345-0@lo:103: 00010000:00010000:0.0:1783947433.959593:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947433.959597:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3c80030000/0x20c3e53e78bb1c6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c67 expref: 18 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947433.959615:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3c80030000/0x20c3e53e78bb1c6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c67 expref: 18 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947433.959625:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c80030000/0x20c3e53e78bb1c6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1c67 expref: 18 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947433.959634:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947433.959656:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:3311:x1870604319878656:12345-0@lo:103: Request processed in 71us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947433.959662:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783947433.959675:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783947433.959681:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:3314:x1870604319878400:12345-0@lo:103: 00010000:00010000:0.0:1783947433.959690:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947433.959695:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3ca9d1a800/0x20c3e53e78bb1c98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c91 expref: 16 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947433.959701:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3ca9d1a800/0x20c3e53e78bb1c98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c91 expref: 16 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947433.959727:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3ca9d1a800/0x20c3e53e78bb1c98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1c91 expref: 16 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947433.959735:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947433.959758:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:3314:x1870604319878400:12345-0@lo:103: Request processed in 78us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947433.959763:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783947433.959992:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783947433.959999:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:8313:x1870604319878272:12345-0@lo:104: 00010000:00010000:0.0:1783947433.960017:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3c80030a00/0x20c3e53e78bb1c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1c0c expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947433.960069:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783947433.960075:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:8313:x1870604319878272:12345-0@lo:104: Request processed in 77us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947433.960081:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783947433.960133:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1870604319878272:0@lo:104: 00000100:00100000:3.0:1783947433.960379:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319878400:0@lo:103: 00000100:00100000:3.0:1783947433.960397:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947433.960404:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319878784:0@lo:103: 00000100:00100000:3.0:1783947433.960454:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947433.960536:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319877632:0@lo:103: 00010000:00010000:3.0:1783947433.960553:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947433.960559:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3c80030a00/0x20c3e53e78bb1c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1c0c expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.960567:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c80030a00 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:3.0:1783947433.960571:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80030a00/0x20c3e53e78bb1c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1c0c expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.960579:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3c80030a00/0x20c3e53e78bb1c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1c0c expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947433.960585:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80030a00/0x20c3e53e78bb1c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1c0c expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947433.960596:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783947433.960622:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3c80030a00/0x20c3e53e78bb1c05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c0c expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.960628:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947433.960640:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3c80030a00/0x20c3e53e78bb1c05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c0c expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.960647:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3c80030a00/0x20c3e53e78bb1c05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c0c expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.960669:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947433.960671:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947433.960673:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947433.960679:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947433.960688:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319879040:0@lo:103: 00000100:00100000:1.0:1783947433.960807:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319878912 00000100:00100000:1.0:1783947433.960812:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319878912 00010000:00010000:1.0:1783947433.960836:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3c8147d800/0x20c3e53e78bb1c36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c2f expref: 15 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947433.960853:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319878784 00000100:00100000:1.0:1783947433.960855:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319878784 00010000:00010000:1.0:1783947433.960865:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3cad73b400/0x20c3e53e78bb1c60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c59 expref: 16 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947433.960876:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783947433.960883:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:3314:x1870604319878912:12345-0@lo:103: 00010000:00010000:1.0:1783947433.960893:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947433.960897:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3c8147d800/0x20c3e53e78bb1c36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c2f expref: 16 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.960906:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3c8147d800/0x20c3e53e78bb1c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c2f expref: 16 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.960918:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c8147d800/0x20c3e53e78bb1c36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1c2f expref: 16 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.960933:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947433.961114:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783947433.961122:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1783947433.961184:0:5783:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783947433.961195:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783947433.961210:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:3314:x1870604319878784:12345-0@lo:103: 00010000:00010000:2.0:1783947433.961218:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947433.961223:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3cad73b400/0x20c3e53e78bb1c60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c59 expref: 15 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947433.961231:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3cad73b400/0x20c3e53e78bb1c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c59 expref: 15 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947433.961241:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cad73b400/0x20c3e53e78bb1c60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1c59 expref: 15 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947433.961249:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947433.961303:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:3314:x1870604319878912:12345-0@lo:103: Request processed in 420us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947433.961315:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783947433.961348:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319878912:0@lo:103: 00000100:00100000:3.0:1783947433.961391:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947433.961569:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319878656:0@lo:103: 00000100:00100000:3.0:1783947433.961578:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319878528:0@lo:103: 00010000:00010000:3.0:1783947433.961597:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947433.961628:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319879040 00000100:00100000:3.0:1783947433.961631:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319879040 00010000:00010000:3.0:1783947433.961645:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3ca9d1a400/0x20c3e53e78bb1c0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c05 expref: 14 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947433.961660:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1783947433.961665:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783947433.961670:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c856ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:3312:x1870604319879040:12345-0@lo:103: 00010000:00010000:3.0:1783947433.961678:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947433.961682:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3ca9d1a400/0x20c3e53e78bb1c0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c05 expref: 14 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.961690:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3ca9d1a400/0x20c3e53e78bb1c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c05 expref: 14 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.962018:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3ca9d1a400/0x20c3e53e78bb1c0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1c05 expref: 14 pid: 5789 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947433.962049:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947433.962088:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c856ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:3312:x1870604319879040:12345-0@lo:103: Request processed in 417us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947433.962095:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783947433.962163:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319879040:0@lo:103: 00000100:00100000:1.0:1783947433.962289:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947433.962328:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947433.962344:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297834496 00000100:00100000:1.0:1783947433.962348:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297834496 00010000:00010000:1.0:1783947433.962363:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3cad73a600/0x20c3e53e78bb1cd7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaead expref: 10 pid: 5790 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947433.962376:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297834624 00000100:00100000:1.0:1783947433.962378:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297834624 00010000:00010000:1.0:1783947433.962386:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3c8147c800/0x20c3e53e78bb1cd0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaea6 expref: 11 pid: 5791 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947433.962398:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:1.0:1783947433.962403:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d64dfe14-87c9-4273-a23c-517e593e369d+11:2354:x1870604297834496:12345-192.168.203.32@tcp:103: 00010000:00010000:1.0:1783947433.962411:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947433.962444:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3cad73a600/0x20c3e53e78bb1cd7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaead expref: 11 pid: 5790 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.962455:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3cad73a600/0x20c3e53e78bb1cd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaead expref: 11 pid: 5790 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.962466:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947433.962504:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d64dfe14-87c9-4273-a23c-517e593e369d+11:2354:x1870604297834496:12345-192.168.203.32@tcp:103: Request processed in 99us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947433.962510:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:1.0:1783947433.962523:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:1.0:1783947433.962534:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d64dfe14-87c9-4273-a23c-517e593e369d+10:2353:x1870604297834624:12345-192.168.203.32@tcp:103: 00010000:00010000:1.0:1783947433.962542:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947433.962547:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3c8147c800/0x20c3e53e78bb1cd0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaea6 expref: 10 pid: 5791 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.962555:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3c8147c800/0x20c3e53e78bb1cd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaea6 expref: 10 pid: 5791 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.962568:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b3cad73bc00/0x20c3e53e78bb1d0f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.962577:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cad73bc00/0x20c3e53e78bb1d0f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.962591:0:5784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3cad73bc00/0x20c3e53e78bb1d0f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.962599:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3cad73bc00/0x20c3e53e78bb1d0f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.962605:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b3cad73bc00/0x20c3e53e78bb1d0f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.962612:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b3cad73bc00/0x20c3e53e78bb1d0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.962618:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73bc00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947433.962623:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b3cad73bc00/0x20c3e53e78bb1d0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.962631:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b3cad73bc00/0x20c3e53e78bb1d0f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.962646:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b3cad73bc00/0x20c3e53e78bb1d0f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947433.962656:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947433.962674:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d64dfe14-87c9-4273-a23c-517e593e369d+10:2353:x1870604297834624:12345-192.168.203.32@tcp:103: Request processed in 141us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947433.962680:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00010000:00010000:0.0:1783947433.963102:0:8313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cad73a600/0x20c3e53e78bb1cd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaead expref: 9 pid: 5790 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947433.963114:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f53b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1870604319877120:192.168.203.32@tcp:104: 00010000:00010000:0.0:1783947433.963125:0:8313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c8147c800/0x20c3e53e78bb1cd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaea6 expref: 8 pid: 5791 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947433.963134:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f52d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1870604319877248:192.168.203.32@tcp:104: 00010000:00010000:0.0:1783947433.963169:0:8313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b3cad73bc00/0x20c3e53e78bb1d0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947433.963178:0:8313:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b3cad73bc00/0x20c3e53e78bb1d0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947433.963184:0:8313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b3cad73bc00/0x20c3e53e78bb1d0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947433.963190:0:8313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cad73bc00/0x20c3e53e78bb1d0f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947433.970226:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:3314:x1870604319878784:12345-0@lo:103: Request processed in 9010us (9764us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947433.970240:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783947433.970472:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319878784:0@lo:103: 00010000:00010000:3.0:1783947434.298471:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947434.758601:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947434.758757:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297834752 00000100:00100000:0.0:1783947434.758768:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297834752 00000100:00100000:0.0:1783947434.758833:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 132 00000100:00100000:0.0:1783947434.758844:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+8:2354:x1870604297834752:12345-192.168.203.32@tcp:400: 00000100:00100000:0.0:1783947434.758920:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+8:2354:x1870604297834752:12345-192.168.203.32@tcp:400: Request processed in 78us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947434.758928:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 132 00000100:00100000:3.0:1783947434.763386:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947434.763551:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947434.763584:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947434.763783:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297834880 00000100:00100000:0.0:1783947434.763792:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297834880 00000100:00100000:0.0:1783947434.763854:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:0.0:1783947434.763864:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297834880:12345-192.168.203.32@tcp:400: 00000100:00100000:0.0:1783947434.763933:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297834880:12345-192.168.203.32@tcp:400: Request processed in 70us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947434.763941:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:0.0:1783947434.763965:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297835136 00000100:00100000:0.0:1783947434.763969:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297835136 00000100:00100000:0.0:1783947434.763992:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297835008 00000100:00100000:0.0:1783947434.763995:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297835008 00000100:00100000:0.0:1783947434.764019:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1783947434.764025:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2353:x1870604297835136:12345-192.168.203.32@tcp:400: 00000100:00100000:0.0:1783947434.764066:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2353:x1870604297835136:12345-192.168.203.32@tcp:400: Request processed in 40us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947434.764073:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1783947434.764087:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:0.0:1783947434.764093:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2353:x1870604297835008:12345-192.168.203.32@tcp:400: 00000100:00100000:0.0:1783947434.764129:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2353:x1870604297835008:12345-192.168.203.32@tcp:400: Request processed in 37us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947434.764136:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00080000:3.0:1783947434.765450:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783947434.765459:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947434.765462:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783947435.322078:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783947435.773231:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783947435.773239:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b3c83398800 from 39 10000000:01000000:0.0:1783947435.773244:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783947435.773305:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030800/0x20c3e53e78bb1d16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947435.773317:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3c80030800/0x20c3e53e78bb1d16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947435.773327:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3c80030800/0x20c3e53e78bb1d16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947435.773353:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aeea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319879168:0@lo:101: 00000100:00100000:0.0:1783947435.773456:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947435.773936:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c90d2d480 going to sleep for 11 seconds 00000100:00100000:2.0:1783947435.774932:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319879168 00000100:00100000:2.0:1783947435.774943:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319879168 00000100:00100000:2.0:1783947435.775069:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783947435.775079:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+12:5793:x1870604319879168:12345-0@lo:101: 00010000:00010000:2.0:1783947435.775096:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947435.775115:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cc0630400/0x20c3e53e78bb1d1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1d16 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947435.775142:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cc0630400/0x20c3e53e78bb1d1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d16 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947435.775153:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cc0630400/0x20c3e53e78bb1d1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d16 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947435.775164:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630400, rc 0) 00000100:00100000:2.0:1783947435.775243:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:5793:x1870604319879168:12345-0@lo:101: Request processed in 166us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947435.775260:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1783947435.775371:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aeea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319879168:0@lo:101: 00010000:00010000:1.0:1783947435.775388:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3c80030800/0x20c3e53e78bb1d16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d1d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947435.775397:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3c80030800/0x20c3e53e78bb1d16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1d1d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947435.775506:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319879296:0@lo:501: 00000100:00100000:1.0:1783947435.775541:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947435.791364:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad698c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947435.796065:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319879296 00000100:00100000:0.0:1783947435.796089:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319879296 00000100:00100000:0.0:1783947435.796154:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783947435.796165:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:5793:x1870604319879296:12345-0@lo:501: 00000100:00100000:0.0:1783947435.796506:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:5793:x1870604319879296:12345-0@lo:501: Request processed in 342us (20962us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947435.796515:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783947435.796946:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319879296:0@lo:501: 00000100:00100000:1.0:1783947435.796996:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319879424:0@lo:503: 00000100:00100000:1.0:1783947435.797056:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947435.797090:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad698c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947435.797224:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319879424 00000100:00100000:0.0:1783947435.797230:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319879424 00000100:00100000:0.0:1783947435.797271:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783947435.797279:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:5793:x1870604319879424:12345-0@lo:503: 00000100:00100000:0.0:1783947435.797469:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:5793:x1870604319879424:12345-0@lo:503: Request processed in 190us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947435.797476:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783947435.797561:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319879424:0@lo:503: 00000100:00100000:1.0:1783947435.798096:0:8331:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8331:1870604319879552:0@lo:502: 00000100:00100000:1.0:1783947435.798147:0:8331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947435.798177:0:8331:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad698180 going to sleep for 11 seconds 00000100:00100000:0.0:1783947435.798450:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319879552 00000100:00100000:0.0:1783947435.798456:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319879552 00000100:00100000:0.0:1783947435.798482:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783947435.798488:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:8331:x1870604319879552:12345-0@lo:502: 00000100:00100000:0.0:1783947435.798794:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:8331:x1870604319879552:12345-0@lo:502: Request processed in 305us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947435.798801:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783947435.798889:0:8331:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8331:1870604319879552:0@lo:502: 00000100:00100000:1.0:1783947435.798933:0:8331:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8331:1870604319879680:0@lo:502: 00000100:00100000:1.0:1783947435.798969:0:8331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947435.798999:0:8331:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad698180 going to sleep for 11 seconds 00000100:00100000:2.0:1783947435.799072:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319879680 00000100:00100000:2.0:1783947435.799077:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319879680 00000100:00100000:2.0:1783947435.799101:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783947435.799107:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:8331:x1870604319879680:12345-0@lo:502: 00000100:00100000:2.0:1783947435.799243:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:8331:x1870604319879680:12345-0@lo:502: Request processed in 135us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947435.799250:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783947435.799344:0:8331:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8331:1870604319879680:0@lo:502: 00000040:00080000:1.0:1783947435.799364:0:8331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1783947435.799668:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1783947435.799686:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783947435.799696:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030800/0x20c3e53e78bb1d16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d1d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947435.799706:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c80030800/0x20c3e53e78bb1d16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d1d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947435.799715:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1783947435.799717:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1783947435.799720:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783947435.799745:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb1d24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947435.799752:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb1d24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947435.799761:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb1d24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947435.799774:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319879808:0@lo:101: 00000100:00100000:2.0:1783947435.799804:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947435.799862:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432f540 going to sleep for 11 seconds 00000100:00100000:3.0:1783947435.799980:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319879808 00000100:00100000:3.0:1783947435.799987:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319879808 00000100:00100000:1.0:1783947435.800037:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783947435.800045:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+13:5793:x1870604319879808:12345-0@lo:101: 00010000:00010000:1.0:1783947435.800054:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947435.800064:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cad73aa00/0x20c3e53e78bb1d2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1d24 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947435.800083:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cad73aa00/0x20c3e53e78bb1d2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d24 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947435.800093:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cad73aa00/0x20c3e53e78bb1d2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d24 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947435.800100:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73aa00, rc 0) 00000100:00100000:1.0:1783947435.800137:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:5793:x1870604319879808:12345-0@lo:101: Request processed in 93us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947435.800142:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783947435.803541:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319879808:0@lo:101: 00010000:00010000:2.0:1783947435.803571:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb1d24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d2b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947435.803584:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb1d24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1d2b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947435.803674:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319879936:0@lo:501: 00000100:00100000:2.0:1783947435.803732:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947435.803779:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432f540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947435.803949:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319879936 00000100:00100000:1.0:1783947435.803969:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319879936 00000100:00100000:1.0:1783947435.804730:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783947435.804743:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:5793:x1870604319879936:12345-0@lo:501: 00000100:00100000:1.0:1783947435.805047:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:5793:x1870604319879936:12345-0@lo:501: Request processed in 309us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947435.805054:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783947435.806755:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319879936:0@lo:501: 00000100:00100000:2.0:1783947435.806812:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319880064:0@lo:503: 00000100:00100000:2.0:1783947435.806883:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947435.806925:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432f540 going to sleep for 11 seconds 00000100:00100000:0.0:1783947435.807005:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319880064 00000100:00100000:0.0:1783947435.807012:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319880064 00000100:00100000:0.0:1783947435.807074:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783947435.807084:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:5793:x1870604319880064:12345-0@lo:503: 00000100:00100000:0.0:1783947435.807280:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:5793:x1870604319880064:12345-0@lo:503: Request processed in 198us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947435.807288:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783947435.807734:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319880064:0@lo:503: 00000100:00100000:0.0:1783947435.827986:0:8332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8332:1870604319880192:0@lo:502: 00000100:00100000:0.0:1783947435.828084:0:8332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947435.828120:0:8332:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c82f670c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947435.828565:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319880192 00000100:00100000:2.0:1783947435.828573:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319880192 00000100:00100000:2.0:1783947435.828623:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783947435.828633:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:8332:x1870604319880192:12345-0@lo:502: 00000100:00100000:2.0:1783947435.828872:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:8332:x1870604319880192:12345-0@lo:502: Request processed in 240us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947435.828880:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783947435.829069:0:8332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8332:1870604319880192:0@lo:502: 00000020:01000000:0.0:1783947435.829100:0:8332:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947435.829109:0:8332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947435.829112:0:8332:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783947435.829118:0:8332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783947435.829147:0:8332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8332:1870604319880320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947435.829202:0:8332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947435.829235:0:8332:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c82f670c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947435.831054:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319880320 00000100:00100000:3.0:1783947435.831068:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319880320 00000100:00100000:3.0:1783947435.831137:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783947435.831147:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:8332:x1870604319880320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947435.831409:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:8332:x1870604319880320:12345-0@lo:502:llog_process_th.0 Request processed in 264us (2206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947435.831457:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1783947435.831728:0:8332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8332:1870604319880320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783947435.831761:0:8332:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947435.831768:0:8332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947435.831770:0:8332:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783947435.831777:0:8332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1783947435.831940:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1783947435.831958:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783947435.831967:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb1d24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d2b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947435.831990:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb1d24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d2b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947435.832000:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783947435.832003:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b3cb6183000 from 39 10000000:01000000:2.0:1783947435.832005:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783947435.832046:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb1d32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947435.832054:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb1d32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947435.832062:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb1d32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947435.832080:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319880448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783947435.832117:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947435.832154:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947435.833233:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319880448 00000100:00100000:3.0:1783947435.833244:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319880448 00000100:00100000:3.0:1783947435.833309:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783947435.833318:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:5793:x1870604319880448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947435.833333:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947435.833345:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c8147de00/0x20c3e53e78bb1d39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1d32 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947435.833371:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c8147de00/0x20c3e53e78bb1d39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d32 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947435.833381:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c8147de00/0x20c3e53e78bb1d39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d32 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947435.833390:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147de00, rc 0) 00000100:00100000:3.0:1783947435.833464:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:5793:x1870604319880448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947435.833471:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1783947435.833683:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319880448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947435.833698:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb1d32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d39 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947435.833707:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb1d32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1d39 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947435.833766:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319880576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947435.833797:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947435.833843:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947435.833933:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319880576 00000100:00100000:0.0:1783947435.833938:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319880576 00000100:00100000:0.0:1783947435.833965:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783947435.833973:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:5793:x1870604319880576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947435.834230:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:5793:x1870604319880576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947435.834237:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783947435.834444:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319880576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947435.834475:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319880704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947435.834518:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947435.834535:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947435.836338:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319880704 00000100:00100000:3.0:1783947435.836353:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319880704 00000100:00100000:3.0:1783947435.836453:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783947435.836463:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:5793:x1870604319880704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947435.836717:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:5793:x1870604319880704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 255us (2197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947435.836725:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783947435.836930:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319880704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947435.837656:0:8333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8333:1870604319880832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947435.837708:0:8333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947435.837742:0:8333:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad6980c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947435.837781:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319880832 00000100:00100000:3.0:1783947435.837787:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319880832 00000100:00100000:3.0:1783947435.837819:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783947435.837826:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:8333:x1870604319880832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947435.838014:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:8333:x1870604319880832:12345-0@lo:502:llog_process_th.0 Request processed in 188us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947435.838036:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783947435.838132:0:8333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8333:1870604319880832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947435.838170:0:8333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8333:1870604319880960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947435.838213:0:8333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947435.838232:0:8333:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad6980c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947435.838362:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319880960 00000100:00100000:0.0:1783947435.838367:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319880960 00000100:00100000:0.0:1783947435.838396:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783947435.838403:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:8333:x1870604319880960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947435.838561:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:8333:x1870604319880960:12345-0@lo:502:llog_process_th.0 Request processed in 158us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947435.838567:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783947435.838748:0:8333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8333:1870604319880960:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783947435.838768:0:8333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1783947435.848212:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1783947435.848259:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783947435.848272:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb1d32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d39 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947435.848284:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb1d32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d39 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947435.848445:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1783947435.848450:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1783947435.848453:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783947435.848498:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c8147d200/0x20c3e53e78bb1d40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947435.848506:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3c8147d200/0x20c3e53e78bb1d40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947435.848516:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3c8147d200/0x20c3e53e78bb1d40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947435.848539:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319881088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947435.848603:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947435.848649:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3ca03e6900 going to sleep for 11 seconds 00000100:00100000:2.0:1783947435.848969:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319881088 00000100:00100000:2.0:1783947435.848977:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319881088 00000100:00100000:2.0:1783947435.849040:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783947435.849050:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:5793:x1870604319881088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947435.849064:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947435.849078:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cc0631400/0x20c3e53e78bb1d47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1d40 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947435.849101:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cc0631400/0x20c3e53e78bb1d47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d40 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947435.849112:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cc0631400/0x20c3e53e78bb1d47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d40 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947435.849139:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631400, rc 0) 00000100:00100000:2.0:1783947435.849196:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:5793:x1870604319881088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947435.849203:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783947435.849412:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319881088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947435.849466:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3c8147d200/0x20c3e53e78bb1d40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d47 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947435.849477:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3c8147d200/0x20c3e53e78bb1d40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1d47 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947435.849536:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319881216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947435.849565:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947435.849584:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3ca03e6900 going to sleep for 11 seconds 00000100:00100000:0.0:1783947435.849679:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319881216 00000100:00100000:0.0:1783947435.849684:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319881216 00000100:00100000:0.0:1783947435.849713:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783947435.849720:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:5793:x1870604319881216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947435.849978:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:5793:x1870604319881216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947435.849992:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783947435.850495:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319881216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947435.850545:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319881344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947435.850589:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947435.850616:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3ca03e6900 going to sleep for 11 seconds 00000100:00100000:0.0:1783947435.850796:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319881344 00000100:00100000:0.0:1783947435.850803:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319881344 00000100:00100000:0.0:1783947435.850840:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783947435.850848:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:5793:x1870604319881344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947435.851036:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:5793:x1870604319881344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947435.851043:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783947435.851123:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319881344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947435.855565:0:8334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8334:1870604319881472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947435.855669:0:8334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947435.855725:0:8334:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783947435.855837:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319881472 00000100:00100000:2.0:1783947435.855846:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319881472 00000100:00100000:2.0:1783947435.855902:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783947435.855913:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:8334:x1870604319881472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947435.858151:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:8334:x1870604319881472:12345-0@lo:502:llog_process_th.0 Request processed in 2227us (2469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947435.858170:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783947435.863732:0:8334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8334:1870604319881472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783947435.866122:0:8334:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947435.866142:0:8334:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947435.866145:0:8334:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783947435.866155:0:8334:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783947435.866210:0:8334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8334:1870604319881600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947435.866301:0:8334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947435.866341:0:8334:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947435.866464:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319881600 00000100:00100000:3.0:1783947435.866472:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319881600 00000100:00100000:3.0:1783947435.866522:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783947435.866530:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:8334:x1870604319881600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947435.866745:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:8334:x1870604319881600:12345-0@lo:502:llog_process_th.0 Request processed in 215us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947435.866752:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783947435.866943:0:8334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8334:1870604319881600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783947435.866967:0:8334:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947435.866973:0:8334:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947435.866975:0:8334:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783947435.866979:0:8334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1783947435.867142:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1783947435.867165:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783947435.867175:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c8147d200/0x20c3e53e78bb1d40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d47 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947435.867194:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c8147d200/0x20c3e53e78bb1d40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d47 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947435.867204:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783947435.867206:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b3c85ce6800 from 39 10000000:01000000:3.0:1783947435.867209:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783947435.867236:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c800/0x20c3e53e78bb1d4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947435.867243:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c800/0x20c3e53e78bb1d4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947435.867253:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c800/0x20c3e53e78bb1d4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947435.867276:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319881728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947435.867308:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947435.867339:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3ca0901b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947435.867450:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319881728 00000100:00100000:0.0:1783947435.867456:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319881728 00000100:00100000:0.0:1783947435.867491:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783947435.867499:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:5793:x1870604319881728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947435.867515:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947435.867529:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c80030000/0x20c3e53e78bb1d55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1d4e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947435.867549:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c80030000/0x20c3e53e78bb1d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d4e expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947435.867559:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c80030000/0x20c3e53e78bb1d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d4e expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947435.867566:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c80030000, rc 0) 00000100:00100000:0.0:1783947435.867595:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319881728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947435.867601:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783947435.869402:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319881728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947435.869471:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c800/0x20c3e53e78bb1d4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947435.869483:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c800/0x20c3e53e78bb1d4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1d55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947435.869567:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319881856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947435.869619:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947435.869655:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3ca0901b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947435.869750:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319881856 00000100:00100000:0.0:1783947435.869757:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319881856 00000100:00100000:0.0:1783947435.869803:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783947435.869812:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319881856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947435.870086:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319881856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947435.870094:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783947435.871327:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319881856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947435.871384:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319881984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947435.871469:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947435.871502:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3ca0901b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947435.872635:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319881984 00000100:00100000:0.0:1783947435.872648:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319881984 00000100:00100000:0.0:1783947435.872711:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783947435.872722:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319881984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947435.872943:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319881984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947435.872960:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783947435.873524:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319881984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947435.886773:0:8335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8335:1870604319882112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947435.886857:0:8335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947435.886896:0:8335:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c856349c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947435.886982:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319882112 00000100:00100000:2.0:1783947435.886989:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319882112 00000100:00100000:2.0:1783947435.887045:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783947435.887054:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:8335:x1870604319882112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947435.887322:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:8335:x1870604319882112:12345-0@lo:502:llog_process_th.0 Request processed in 269us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947435.887330:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783947435.887605:0:8335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8335:1870604319882112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947435.887655:0:8335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8335:1870604319882240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947435.887697:0:8335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947435.887716:0:8335:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c856349c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947435.888285:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319882240 00000100:00100000:2.0:1783947435.888291:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319882240 00000100:00100000:2.0:1783947435.888334:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783947435.888342:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:8335:x1870604319882240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947435.888574:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:8335:x1870604319882240:12345-0@lo:502:llog_process_th.0 Request processed in 232us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947435.888588:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783947435.888764:0:8335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8335:1870604319882240:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783947435.888793:0:8335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1783947435.888946:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1783947435.888973:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783947435.888983:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c800/0x20c3e53e78bb1d4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947435.888994:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c800/0x20c3e53e78bb1d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947435.889003:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783947435.889006:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1783947435.889009:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783947435.889045:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1d5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947435.889054:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1d5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947435.889063:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1d5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947435.889079:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319882368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783947435.889113:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947435.889144:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783947435.889194:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319882368 00000100:00100000:3.0:1783947435.889199:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319882368 00000100:00100000:3.0:1783947435.889232:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783947435.889239:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319882368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947435.889248:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947435.889260:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c8147d800/0x20c3e53e78bb1d63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1d5c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947435.889283:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c8147d800/0x20c3e53e78bb1d63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d5c expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947435.889294:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c8147d800/0x20c3e53e78bb1d63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d5c expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947435.889303:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147d800, rc 0) 00000100:00100000:3.0:1783947435.889341:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319882368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947435.889348:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783947435.889407:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319882368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947435.889447:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1d5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947435.889469:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1d5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1d63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947435.889516:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319882496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947435.889540:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947435.889559:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947435.889627:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319882496 00000100:00100000:1.0:1783947435.889631:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319882496 00000100:00100000:1.0:1783947435.889653:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783947435.889659:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319882496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947435.889886:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319882496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947435.889893:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783947435.890021:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319882496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947435.890059:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319882624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947435.890095:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947435.890122:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947435.890160:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319882624 00000100:00100000:1.0:1783947435.890164:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319882624 00000100:00100000:1.0:1783947435.890199:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783947435.890205:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319882624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947435.890342:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319882624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947435.890348:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783947435.890516:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319882624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947435.890802:0:8336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8336:1870604319882752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947435.890838:0:8336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947435.890867:0:8336:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672300 going to sleep for 11 seconds 00000100:00100000:1.0:1783947435.890908:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319882752 00000100:00100000:1.0:1783947435.890913:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319882752 00000100:00100000:1.0:1783947435.890934:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783947435.890940:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:8336:x1870604319882752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947435.891115:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:8336:x1870604319882752:12345-0@lo:502:llog_process_th.0 Request processed in 175us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947435.891122:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783947435.891344:0:8336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8336:1870604319882752:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783947435.891369:0:8336:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947435.891376:0:8336:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947435.891378:0:8336:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783947435.891385:0:8336:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783947435.891404:0:8336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8336:1870604319882880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947435.891498:0:8336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947435.891515:0:8336:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672300 going to sleep for 11 seconds 00000100:00100000:1.0:1783947435.891603:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319882880 00000100:00100000:1.0:1783947435.891608:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319882880 00000100:00100000:1.0:1783947435.891632:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783947435.891639:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:8336:x1870604319882880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947435.891788:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:8336:x1870604319882880:12345-0@lo:502:llog_process_th.0 Request processed in 149us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947435.891794:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783947435.898731:0:8336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8336:1870604319882880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783947435.898793:0:8336:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947435.898802:0:8336:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947435.898804:0:8336:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783947435.898809:0:8336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1783947435.899034:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1783947435.899055:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783947435.899065:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1d5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947435.899076:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1d5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947435.899096:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783947435.899098:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8b3c85974d40 from 1 10000000:01000000:1.0:1783947435.899101:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783947435.899130:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1d6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947435.899137:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1d6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947435.899145:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1d6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947435.899165:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319883008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947435.899235:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947435.899273:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad698300 going to sleep for 11 seconds 00000100:00100000:0.0:1783947435.899377:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319883008 00000100:00100000:0.0:1783947435.899383:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319883008 00000100:00100000:0.0:1783947435.899471:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783947435.899480:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319883008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947435.899492:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947435.899504:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c80030a00/0x20c3e53e78bb1d71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1d6a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947435.899526:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c80030a00/0x20c3e53e78bb1d71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d6a expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947435.899535:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c80030a00/0x20c3e53e78bb1d71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d6a expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947435.899543:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c80030a00, rc 0) 00000100:00100000:0.0:1783947435.899586:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319883008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947435.899594:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783947435.899850:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319883008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947435.899863:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1d6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947435.899872:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1d6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1d71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947435.899920:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319883136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947435.899946:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947435.899973:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad698300 going to sleep for 11 seconds 00000100:00100000:2.0:1783947435.900035:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319883136 00000100:00100000:2.0:1783947435.900041:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319883136 00000100:00100000:2.0:1783947435.900072:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783947435.900080:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319883136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947435.900311:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319883136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (363us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783947435.900319:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783947435.900456:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319883136:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1783947435.900479:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783947435.900491:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1d6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947435.900499:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1d6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947436.089936:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947436.089962:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319883264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947436.090043:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947436.090597:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319883264 00000100:00100000:2.0:1783947436.090605:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319883264 00000100:00100000:2.0:1783947436.090666:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783947436.090675:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319883264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947436.090708:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947436.090756:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319883264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947436.090763:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1783947436.090832:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947436.090885:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319883520:0@lo:400:kworker.0 00000100:00100000:1.0:1783947436.090918:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947436.090949:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947436.090955:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870604319883392:0@lo:400:kworker.0 00000100:00100000:1.0:1783947436.090977:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947436.091012:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319883648:0@lo:400:kworker.0 00000100:00100000:1.0:1783947436.091044:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783947436.091084:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c85c32680 x1870604319883264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947436.091102:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319883264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947436.091119:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947436.091124:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319883776:0@lo:400:kworker.0 00000100:00100000:1.0:1783947436.091153:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947436.091293:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319883520 00000100:00100000:3.0:1783947436.091297:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319883520 00000100:00100000:3.0:1783947436.091347:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319883392 00000100:00100000:3.0:1783947436.091350:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319883392 00000100:00100000:3.0:1783947436.091362:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319883648 00000100:00100000:3.0:1783947436.091364:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319883648 00000100:00100000:3.0:1783947436.091399:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783947436.091405:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319883520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947436.091475:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319883520:12345-0@lo:400:kworker.0 Request processed in 69us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947436.091481:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783947436.091495:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783947436.091501:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870604319883392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947436.091528:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870604319883392:12345-0@lo:400:kworker.0 Request processed in 28us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947436.091533:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783947436.091544:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783947436.091551:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319883648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947436.091579:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319883648:12345-0@lo:400:kworker.0 Request processed in 28us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947436.091584:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783947436.091613:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870604319883392:0@lo:400:kworker.0 00000100:00100000:3.0:1783947436.091621:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319883520:0@lo:400:kworker.0 00000100:00100000:0.0:1783947436.091837:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319883776 00000100:00100000:0.0:1783947436.091843:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319883776 00000100:00100000:0.0:1783947436.091882:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783947436.091889:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319883776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947436.091926:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319883776:12345-0@lo:400:kworker.0 Request processed in 39us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947436.091932:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1783947436.092192:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947436.092197:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783947436.092219:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c85c30000 x1870604319883776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947436.092241:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319883776:0@lo:400:kworker.0 00000100:00100000:1.0:1783947436.092253:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319883648:0@lo:400:kworker.0 00010000:00010000:3.0:1783947436.345718:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947436.602093:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947436.602117:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319883904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947436.602201:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947436.602495:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319883904 00000100:00100000:0.0:1783947436.602502:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319883904 00000100:00100000:0.0:1783947436.602554:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783947436.602564:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319883904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783947436.602597:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947436.602651:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319883904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947436.602659:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1783947436.602776:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cb6aec000 x1870604319883904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947436.602794:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319883904:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783947437.370900:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947437.765387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947437.765508:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297835264 00000100:00100000:0.0:1783947437.765526:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297835264 00000100:00100000:0.0:1783947437.765673:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 165 00000100:00100000:0.0:1783947437.765685:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+8:5573:x1870604297835264:12345-192.168.203.32@tcp:101: 00010000:00010000:0.0:1783947437.765703:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947437.765721:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c80031c00/0x20c3e53e78bb1d78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aaf0f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947437.765748:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c80031c00/0x20c3e53e78bb1d78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf0f expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947437.765760:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c80031c00/0x20c3e53e78bb1d78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf0f expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947437.765768:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c80031c00, rc 0) 00000100:00100000:0.0:1783947437.765837:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+9:5573:x1870604297835264:12345-192.168.203.32@tcp:101: Request processed in 154us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947437.765843:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 165 00000100:00100000:1.0:1783947437.770121:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947437.770355:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297835392 00000100:00100000:0.0:1783947437.770366:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297835392 00000100:00100000:0.0:1783947437.770466:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 166 00000100:00100000:0.0:1783947437.770477:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+9:5573:x1870604297835392:12345-192.168.203.32@tcp:501: 00000100:00100000:0.0:1783947437.770783:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+9:5573:x1870604297835392:12345-192.168.203.32@tcp:501: Request processed in 309us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947437.770791:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 166 00000100:00100000:3.0:1783947437.773582:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947437.773787:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297835520 00000100:00100000:0.0:1783947437.773798:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297835520 00000100:00100000:0.0:1783947437.773856:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 167 00000100:00100000:0.0:1783947437.773865:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+9:5573:x1870604297835520:12345-192.168.203.32@tcp:503: 00000100:00100000:0.0:1783947437.774103:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+9:5573:x1870604297835520:12345-192.168.203.32@tcp:503: Request processed in 238us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947437.774111:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 167 00000100:00100000:3.0:1783947437.779471:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947437.780024:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297835648 00000100:00100000:2.0:1783947437.780034:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297835648 00000100:00100000:2.0:1783947437.780088:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 168 00000100:00100000:2.0:1783947437.780098:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+9:6058:x1870604297835648:12345-192.168.203.32@tcp:502: 00000100:00100000:2.0:1783947437.780363:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+9:6058:x1870604297835648:12345-192.168.203.32@tcp:502: Request processed in 265us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947437.780371:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 168 00000100:00100000:3.0:1783947437.784105:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947437.784356:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297835776 00000100:00100000:1.0:1783947437.784366:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297835776 00000100:00100000:1.0:1783947437.784459:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 169 00000100:00100000:1.0:1783947437.784470:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+9:6058:x1870604297835776:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783947437.784754:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+9:6058:x1870604297835776:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 284us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947437.784762:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 169 00000100:00100000:3.0:1783947437.794988:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947437.795752:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297835904 00000100:00100000:0.0:1783947437.795768:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297835904 00000100:00100000:0.0:1783947437.795834:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 170 00000100:00100000:0.0:1783947437.795845:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+9:5573:x1870604297835904:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947437.795863:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947437.795882:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c80030400/0x20c3e53e78bb1d7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aaf16 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947437.795911:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c80030400/0x20c3e53e78bb1d7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf16 expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947437.795922:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c80030400/0x20c3e53e78bb1d7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf16 expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947437.795931:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c80030400, rc 0) 00000100:00100000:0.0:1783947437.796008:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+10:5573:x1870604297835904:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 165us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947437.796026:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 170 00000100:00100000:3.0:1783947437.810542:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947437.810627:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297836032 00000100:00100000:2.0:1783947437.810638:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297836032 00000100:00100000:2.0:1783947437.810704:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 171 00000100:00100000:2.0:1783947437.810713:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+10:5573:x1870604297836032:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947437.810993:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+10:5573:x1870604297836032:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 280us (461us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783947437.811001:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 171 00010000:00010000:3.0:1783947438.393743:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947439.427183:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783947439.789280:0:8375:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd57096010 20000000:00000080:2.0:1783947439.789297:0:8375:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b3cbd9f0400 uarg=0000000000000000 20000000:01000000:2.0:1783947439.789331:0:8375:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783947439.789337:0:8375:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783947439.789342:0:8375:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783947439.803450:0:8376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1783947439.806501:0:8375:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1783947439.814571:0:8375:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1783947439.814633:0:8375:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1783947439.814686:0:8375:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1783947439.814705:0:8375:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783947439.814728:0:8375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1d86 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947439.814750:0:8375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3c813d0a00/0x20c3e53e78bb1afb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1af4 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947439.814757:0:8375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1b5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1b56 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947439.814763:0:8375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1c28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1c21 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947439.814772:0:8375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3c8147ce00/0x20c3e53e78bb1ce5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaede expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947439.814780:0:8375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1d86 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947439.814825:0:8375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3c8147ce00/0x20c3e53e78bb1ce5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaede expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947439.814914:0:8375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b3c8147ce00/0x20c3e53e78bb1ce5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaede expref: 9 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947439.814940:0:8375:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c32a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8375:1870604319884032:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947439.815061:0:8375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1c28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1c21 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947439.815072:0:8375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1c28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c21 expref: 18 pid: 5789 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947439.815081:0:8375:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c33b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8375:1870604319884160:0@lo:104: 00000100:00100000:3.0:1783947439.815123:0:8375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783947439.815177:0:8375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1b5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1b56 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947439.815187:0:8375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1b5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b56 expref: 18 pid: 5790 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947439.815195:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319884160 00000100:00100000:3.0:1783947439.815196:0:8375:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c30000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8375:1870604319884288:0@lo:104: 00000100:00100000:2.0:1783947439.815205:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319884160 00000100:00100000:3.0:1783947439.815224:0:8375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947439.815256:0:5780:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783947439.815268:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319884288 00000100:00100000:2.0:1783947439.815271:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319884288 00000100:00100000:2.0:1783947439.815287:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783947439.815297:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+4:8375:x1870604319884160:12345-0@lo:104: 00010000:00010000:2.0:1783947439.815311:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1c21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1c28 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947439.815361:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783947439.815372:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+4:8375:x1870604319884160:12345-0@lo:104: Request processed in 72us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947439.815379:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783947439.815397:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783947439.815411:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:8375:x1870604319884288:12345-0@lo:104: 00010000:00010000:2.0:1783947439.815443:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3c80030c00/0x20c3e53e78bb1b56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1b5d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947439.815479:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783947439.815485:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:8375:x1870604319884288:12345-0@lo:104: Request processed in 75us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947439.815490:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1783947439.815552:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947439.815557:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1c21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1c28 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947439.815565:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b600 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:2.0:1783947439.815569:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1c21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1c28 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947439.815577:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1c21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1c28 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947439.815584:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1c21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1c28 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947439.815589:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783947439.815617:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1c21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c28 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947439.815623:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947439.815642:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1c21 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c28 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947439.815659:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1c21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1c28 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947439.815673:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947439.815677:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3c80030c00/0x20c3e53e78bb1b56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1b5d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947439.815683:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c80030c00 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:2.0:1783947439.815685:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80030c00/0x20c3e53e78bb1b56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1b5d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947439.815692:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3c80030c00/0x20c3e53e78bb1b56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1b5d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947439.815698:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80030c00/0x20c3e53e78bb1b56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1b5d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947439.815703:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783947439.815810:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947439.816698:0:8375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3c813d0a00/0x20c3e53e78bb1afb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1af4 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947439.816712:0:8375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3c813d0a00/0x20c3e53e78bb1afb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1af4 expref: 18 pid: 5791 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947439.816724:0:8375:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c32680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8375:1870604319884544:0@lo:104: 00000100:00100000:3.0:1783947439.816767:0:8375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783947439.817141:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3c80030c00/0x20c3e53e78bb1b56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1b5d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947439.817150:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947439.817187:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3c80030c00/0x20c3e53e78bb1b56 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1b5d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947439.817195:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3c80030c00/0x20c3e53e78bb1b56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1b5d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947439.817210:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947439.817224:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947439.817226:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947439.817248:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319884416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947439.817281:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947439.817340:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319884416 00000100:00100000:2.0:1783947439.817347:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319884416 00010000:00010000:2.0:1783947439.817373:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1c28 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c21 expref: 19 pid: 5789 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947439.817403:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783947439.817411:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319884416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947439.817454:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947439.817461:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1c28 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c21 expref: 19 pid: 5789 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947439.817471:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1c28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1c21 expref: 19 pid: 5789 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947439.817492:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947439.817524:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319884416:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947439.817531:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783947439.817586:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319884416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947439.817615:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319884544 00000100:00100000:2.0:1783947439.817619:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319884544 00000100:00100000:3.0:1783947439.817622:0:8375:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e2b3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1783947439.817643:0:8375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1c28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1c21 expref: 18 pid: 5789 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947439.817650:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783947439.817657:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:8375:x1870604319884544:12345-0@lo:104: 00010000:00010000:2.0:1783947439.817670:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ba00/0x20c3e53e78bb1af4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1afb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947439.817674:0:8375:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c33b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8375:1870604319884160:0@lo:104: 00000100:00100000:3.0:1783947439.817691:0:8375:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c30000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8375:1870604319884288:0@lo:104: 00010000:00010000:2.0:1783947439.817729:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783947439.817732:0:8375:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c32680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8375:1870604319884544:0@lo:104: 00000100:00100000:2.0:1783947439.817738:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:8375:x1870604319884544:12345-0@lo:104: Request processed in 80us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947439.817746:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1783947439.817764:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947439.817769:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ba00/0x20c3e53e78bb1af4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1afb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947439.817775:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1ba00 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:2.0:1783947439.817778:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ba00/0x20c3e53e78bb1af4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1afb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947439.817786:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ba00/0x20c3e53e78bb1af4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1afb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947439.817793:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ba00/0x20c3e53e78bb1af4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1afb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947439.817798:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783947439.817830:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ba00/0x20c3e53e78bb1af4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1afb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947439.817836:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947439.817843:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ba00/0x20c3e53e78bb1af4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1afb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947439.817849:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ba00/0x20c3e53e78bb1af4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1afb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947439.817874:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947439.817876:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947439.817877:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947439.818236:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83370a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319884672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947439.818272:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947439.818305:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947439.818310:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319884800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947439.818329:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947439.818459:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319884672 00000100:00100000:3.0:1783947439.818465:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319884672 00010000:00010000:3.0:1783947439.818485:0:8318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1b5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b56 expref: 18 pid: 5790 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947439.818505:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319884800 00000100:00100000:3.0:1783947439.818516:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319884800 00010000:00010000:3.0:1783947439.818528:0:8318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3c813d0a00/0x20c3e53e78bb1afb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1af4 expref: 19 pid: 5791 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947439.818551:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783947439.818558:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3311:x1870604319884672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783947439.818569:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947439.818574:0:8318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1b5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b56 expref: 19 pid: 5790 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947439.818582:0:8318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1b5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1b56 expref: 19 pid: 5790 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947439.818594:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1b5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1b56 expref: 19 pid: 5790 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947439.818606:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947439.818635:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:3311:x1870604319884672:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947439.818651:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783947439.818665:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783947439.818671:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:3311:x1870604319884800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783947439.818678:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947439.818684:0:8318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3c813d0a00/0x20c3e53e78bb1afb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1af4 expref: 17 pid: 5791 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947439.818691:0:8318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3c813d0a00/0x20c3e53e78bb1afb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1af4 expref: 17 pid: 5791 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947439.818700:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c813d0a00/0x20c3e53e78bb1afb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1af4 expref: 17 pid: 5791 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947439.818709:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947439.818731:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:3311:x1870604319884800:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947439.818737:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783947439.818937:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319884800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947439.818945:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83370a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319884672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947439.821683:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947439.821919:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297836160 00000100:00100000:1.0:1783947439.821931:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297836160 00010000:00010000:1.0:1783947439.821985:0:8318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3c8147ce00/0x20c3e53e78bb1ce5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaede expref: 10 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947439.822035:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:1.0:1783947439.822060:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d64dfe14-87c9-4273-a23c-517e593e369d+10:2353:x1870604297836160:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947439.822074:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947439.822080:0:8318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3c8147ce00/0x20c3e53e78bb1ce5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaede expref: 10 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947439.822093:0:8318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3c8147ce00/0x20c3e53e78bb1ce5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaede expref: 10 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947439.822115:0:8318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1d86 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947439.822123:0:8318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1d86 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947439.822139:0:8318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1d86 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947439.822145:0:8318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1d86 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947439.822152:0:8318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1d86 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947439.822158:0:8318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1d86 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947439.822164:0:8318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147d000 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947439.822168:0:8318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1d86 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947439.822175:0:8318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1d86 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947439.822191:0:8318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1d86 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947439.822200:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947439.822259:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d64dfe14-87c9-4273-a23c-517e593e369d+10:2353:x1870604297836160:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 200us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947439.822268:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 24 00010000:00010000:0.0:1783947439.822853:0:8375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c8147ce00/0x20c3e53e78bb1ce5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaede expref: 9 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947439.822870:0:8375:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c32a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8375:1870604319884032:192.168.203.32@tcp:104: 00010000:00010000:0.0:1783947439.822901:0:8375:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1d86 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947439.822911:0:8375:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1d86 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947439.822917:0:8375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1d86 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947439.822923:0:8375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c8147d000/0x20c3e53e78bb1d86 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947439.881473:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947439.881513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947439.881544:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947439.881573:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297836416 00000100:00100000:1.0:1783947439.881583:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297836416 00000100:00100000:1.0:1783947439.881780:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297836544 00000100:00100000:1.0:1783947439.881785:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297836544 00000100:00100000:1.0:1783947439.881814:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:1.0:1783947439.881824:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297836416:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947439.881899:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297836416:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 77us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947439.881907:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:1.0:1783947439.881923:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:1.0:1783947439.881931:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297836544:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947439.881958:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297836544:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 28us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947439.881964:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00080000:1.0:1783947439.881981:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947439.881992:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947439.885128:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297836288 00000100:00100000:3.0:1783947439.885143:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297836288 00000100:00100000:3.0:1783947439.885220:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:3.0:1783947439.885230:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297836288:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947439.885301:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297836288:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 73us (3787us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947439.885307:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00080000:1.0:1783947439.885364:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783947440.444265:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783947440.959747:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783947440.959755:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3c83398800 from 4 10000000:01000000:1.0:1783947440.959760:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947440.959808:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b800/0x20c3e53e78bb1d8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947440.959819:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b800/0x20c3e53e78bb1d8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947440.959831:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b800/0x20c3e53e78bb1d8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947440.959859:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319884928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947440.959929:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947440.960001:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad698a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947440.960131:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319884928 00000100:00100000:2.0:1783947440.960139:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319884928 00000100:00100000:2.0:1783947440.960201:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1783947440.960212:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:5793:x1870604319884928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947440.960226:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947440.960241:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1d94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1d8d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947440.960264:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1d94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d8d expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947440.960276:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1d94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d8d expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947440.960285:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631a00, rc 0) 00000100:00100000:2.0:1783947440.960325:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319884928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947440.960331:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783947440.960485:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319884928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947440.960500:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b800/0x20c3e53e78bb1d8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d94 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947440.960509:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b800/0x20c3e53e78bb1d8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1d94 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947440.960565:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319885056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947440.960589:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947440.960604:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad698a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947440.960751:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319885056 00000100:00100000:3.0:1783947440.960766:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319885056 00000100:00100000:3.0:1783947440.960803:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1783947440.960811:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319885056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947440.961175:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319885056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 364us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947440.961183:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1783947440.961273:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319885056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947440.961302:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319885184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947440.961339:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947440.961366:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad698a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947440.961398:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319885184 00000100:00100000:2.0:1783947440.961402:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319885184 00000100:00100000:2.0:1783947440.961454:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783947440.961461:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319885184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947440.961601:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319885184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947440.961615:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783947440.961744:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319885184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947440.963936:0:8404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aeed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8404:1870604319885312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947440.964045:0:8404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947440.964094:0:8404:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947440.964204:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319885312 00000100:00100000:1.0:1783947440.964212:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319885312 00000100:00100000:1.0:1783947440.964263:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783947440.964273:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:8404:x1870604319885312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947440.964512:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:8404:x1870604319885312:12345-0@lo:502:llog_process_th.0 Request processed in 240us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947440.964520:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783947440.964715:0:8404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aeed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8404:1870604319885312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783947440.964748:0:8404:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947440.964757:0:8404:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947440.964760:0:8404:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783947440.964767:0:8404:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b3c83398800 00000020:00000080:0.0:1783947440.964769:0:8404:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783947440.964850:0:8404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aeed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8404:1870604319885440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947440.964885:0:8404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947440.964901:0:8404:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947440.970153:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319885440 00000100:00100000:1.0:1783947440.970173:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319885440 00000100:00100000:1.0:1783947440.970237:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1783947440.970248:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:8404:x1870604319885440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947440.970541:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:8404:x1870604319885440:12345-0@lo:502:llog_process_th.0 Request processed in 294us (5654us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947440.970549:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1783947440.970620:0:8404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aeed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8404:1870604319885440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783947440.970656:0:8404:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947440.970663:0:8404:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947440.970665:0:8404:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783947440.970670:0:8404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783947440.970803:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1783947440.970821:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947440.970830:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b800/0x20c3e53e78bb1d8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d94 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947440.970841:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b800/0x20c3e53e78bb1d8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d94 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947440.970858:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783947440.970861:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3cb6183000 from 4 10000000:01000000:1.0:1783947440.970863:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947440.970895:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1d9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947440.970903:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1d9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947440.970912:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1d9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947440.970930:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319885568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947440.970966:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947440.971009:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad698cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947440.971022:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319885568 00000100:00100000:1.0:1783947440.971035:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319885568 00000100:00100000:1.0:1783947440.971061:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783947440.971068:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319885568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947440.971078:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947440.971089:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb1da2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1d9b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947440.971107:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb1da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d9b expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947440.971117:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb1da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d9b expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947440.971135:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73b600, rc 0) 00000100:00100000:1.0:1783947440.971160:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319885568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947440.971167:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783947440.971195:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319885568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947440.971204:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1d9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1da2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947440.971213:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1d9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1da2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947440.972372:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319885696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947440.972428:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947440.972458:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad698cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947440.972476:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319885696 00000100:00100000:1.0:1783947440.972481:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319885696 00000100:00100000:1.0:1783947440.972510:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783947440.972516:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319885696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947440.972748:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319885696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947440.972755:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783947440.972800:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319885696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947440.972836:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319885824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947440.972873:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947440.972892:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad698cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947440.972905:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319885824 00000100:00100000:1.0:1783947440.972908:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319885824 00000100:00100000:1.0:1783947440.972930:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783947440.972936:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319885824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947440.973083:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319885824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947440.973090:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783947440.973125:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319885824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947440.973282:0:8408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8408:1870604319885952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947440.973316:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947440.973334:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319885952 00000100:00100000:1.0:1783947440.973338:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319885952 00000100:00100000:1.0:1783947440.973358:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783947440.973364:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:8408:x1870604319885952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947440.973520:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:8408:x1870604319885952:12345-0@lo:502:llog_process_th.0 Request processed in 156us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947440.973527:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783947440.973556:0:8408:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad6989c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947440.973568:0:8408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8408:1870604319885952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783947440.973592:0:8408:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947440.973601:0:8408:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947440.973603:0:8408:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783947440.973609:0:8408:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b3cb6183000 00000020:00000080:1.0:1783947440.973611:0:8408:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783947440.974618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947440.974647:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297836672 00000100:00100000:3.0:1783947440.974653:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297836672 00000100:00100000:3.0:1783947440.974686:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 181 00000100:00100000:3.0:1783947440.974694:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+9:5573:x1870604297836672:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947440.974707:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947440.974726:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1da9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aaf1d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947440.974752:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf1d expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947440.974763:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf1d expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947440.974773:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147c200, rc 0) 00000100:00100000:3.0:1783947440.974818:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+10:5573:x1870604297836672:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 124us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947440.974825:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 181 00000100:00100000:0.0:1783947440.977208:0:8408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8408:1870604319886080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947440.977285:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947440.977330:0:8408:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1783947440.977670:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319886080 00000100:00100000:1.0:1783947440.977678:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319886080 00000100:00100000:1.0:1783947440.982090:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1783947440.982111:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:8408:x1870604319886080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947440.982383:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:8408:x1870604319886080:12345-0@lo:502:llog_process_th.0 Request processed in 279us (5096us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947440.982392:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1783947440.985279:0:8408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8408:1870604319886080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783947440.985325:0:8408:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947440.985334:0:8408:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947440.985336:0:8408:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783947440.985342:0:8408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783947440.985406:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1783947440.985444:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947440.985454:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1d9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1da2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947440.985465:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1d9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1da2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947440.985475:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783947440.985477:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3c85ce6800 from 4 10000000:01000000:1.0:1783947440.985480:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947440.985510:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b200/0x20c3e53e78bb1db0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947440.985518:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b200/0x20c3e53e78bb1db0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947440.985527:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b200/0x20c3e53e78bb1db0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947440.985562:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319886208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947440.985616:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947440.985652:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947440.987570:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319886208 00000100:00100000:3.0:1783947440.987590:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319886208 00000100:00100000:3.0:1783947440.987633:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1783947440.987643:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319886208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947440.987658:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947440.987674:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1db7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1db0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947440.987699:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1db0 expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947440.987712:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1db0 expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947440.987722:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147d600, rc 0) 00000100:00100000:3.0:1783947440.987787:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319886208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (2170us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947440.987794:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1783947440.987844:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319886208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947440.987861:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b200/0x20c3e53e78bb1db0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1db7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947440.987871:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b200/0x20c3e53e78bb1db0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1db7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947440.987940:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319886336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947440.987970:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947440.989309:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947440.989341:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319886336 00000100:00100000:2.0:1783947440.989348:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319886336 00000100:00100000:2.0:1783947440.989377:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297836800 00000100:00100000:2.0:1783947440.989380:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297836800 00000100:00100000:2.0:1783947440.989396:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1783947440.989404:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319886336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947440.989692:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319886336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947440.989700:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1783947440.989730:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 185 00000100:00100000:2.0:1783947440.989737:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+10:5573:x1870604297836800:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947440.989862:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+10:5573:x1870604297836800:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 125us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947440.989870:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 185 00000100:00100000:3.0:1783947440.996279:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e2b000 going to sleep for 11 seconds 00000100:00100000:3.0:1783947440.996399:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319886336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947440.999899:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319886464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947440.999999:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947441.003536:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947441.003621:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319886464 00000100:00100000:1.0:1783947441.003633:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319886464 00000100:00100000:1.0:1783947441.003678:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297836928 00000100:00100000:1.0:1783947441.003681:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297836928 00000100:00100000:1.0:1783947441.003698:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783947441.003708:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319886464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947441.003929:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319886464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (3939us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947441.003938:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783947441.003979:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 187 00000100:00100000:1.0:1783947441.003987:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+10:5573:x1870604297836928:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947441.004102:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+10:5573:x1870604297836928:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 116us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947441.004109:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 187 00000100:00100000:3.0:1783947441.016305:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e2b000 going to sleep for 10 seconds 00000100:00100000:3.0:1783947441.016355:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319886464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947441.016624:0:8410:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8410:1870604319886592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947441.016706:0:8410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947441.016731:0:8410:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e2b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947441.017038:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947441.018219:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319886592 00000100:00100000:3.0:1783947441.018233:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319886592 00000100:00100000:3.0:1783947441.018286:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297837056 00000100:00100000:3.0:1783947441.018290:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297837056 00000100:00100000:2.0:1783947441.018487:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1783947441.018499:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:8410:x1870604319886592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947441.018747:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:8410:x1870604319886592:12345-0@lo:502:llog_process_th.0 Request processed in 249us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947441.018755:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1783947441.018977:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 189 00000100:00100000:3.0:1783947441.018985:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+10:6115:x1870604297837056:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783947441.019111:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+10:6115:x1870604297837056:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 126us (2075us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947441.019118:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 189 00000100:00100000:3.0:1783947441.019250:0:8410:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8410:1870604319886592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783947441.019282:0:8410:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947441.019290:0:8410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947441.019292:0:8410:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783947441.019376:0:8410:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b3c85ce6800 00000020:00000080:3.0:1783947441.019378:0:8410:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783947441.019543:0:8410:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8410:1870604319886720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947441.019590:0:8410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947441.019614:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319886720 00000100:00100000:3.0:1783947441.019626:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319886720 00000100:00100000:3.0:1783947441.019648:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1783947441.019654:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:8410:x1870604319886720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947441.019763:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:8410:x1870604319886720:12345-0@lo:502:llog_process_th.0 Request processed in 109us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947441.019770:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1783947441.019811:0:8410:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e2b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947441.019823:0:8410:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:8410:1870604319886720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783947441.019841:0:8410:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947441.019845:0:8410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947441.019847:0:8410:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783947441.019850:0:8410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783947441.019907:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783947441.019924:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783947441.019933:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b200/0x20c3e53e78bb1db0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1db7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947441.019944:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b200/0x20c3e53e78bb1db0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1db7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947441.049379:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947441.049488:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297837184 00000100:00100000:3.0:1783947441.049499:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297837184 00000100:00100000:3.0:1783947441.049559:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 191 00000100:00100000:3.0:1783947441.049572:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+10:6115:x1870604297837184:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783947441.055935:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+10:6115:x1870604297837184:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 6353us (6552us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947441.055951:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 191 00000100:00100000:1.0:1783947441.211039:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319887232:0@lo:400:kworker.0 00000100:00100000:1.0:1783947441.211106:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947441.211171:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947441.211178:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1870604319887104:0@lo:400:kworker.0 00000100:00100000:1.0:1783947441.211204:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947441.211234:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319887232 00000100:00100000:1.0:1783947441.211252:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319887232 00000100:00100000:1.0:1783947441.211316:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783947441.211325:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319887232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947441.211373:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319887232:12345-0@lo:400:kworker.0 Request processed in 50us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947441.211380:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783947441.211400:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319887104 00000100:00100000:1.0:1783947441.211404:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319887104 00000100:00100000:1.0:1783947441.211455:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783947441.211462:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870604319887104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947441.211491:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870604319887104:12345-0@lo:400:kworker.0 Request processed in 30us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947441.211509:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1783947441.211524:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947441.211528:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947441.211558:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1870604319887104:0@lo:400:kworker.0 00010000:00080000:1.0:1783947441.211572:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd97e300 x1870604319887232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947441.211582:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319887232:0@lo:400:kworker.0 00000100:00100000:2.0:1783947441.212166:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319886848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947441.212207:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947441.212238:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319887360:0@lo:400:kworker.0 00000100:00100000:2.0:1783947441.212262:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947441.212300:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783947441.212307:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319886976:0@lo:400:kworker.0 00000100:00100000:2.0:1783947441.212330:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947441.212349:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319887488:0@lo:400:kworker.0 00000100:00100000:2.0:1783947441.212370:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947441.212413:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319887360 00000100:00100000:2.0:1783947441.212435:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319887360 00000100:00100000:2.0:1783947441.212471:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319886976 00000100:00100000:2.0:1783947441.212473:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319886976 00000100:00100000:3.0:1783947441.212590:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783947441.212600:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319887360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947441.212646:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319887360:12345-0@lo:400:kworker.0 Request processed in 49us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947441.212653:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783947441.212670:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783947441.212676:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319886976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947441.212703:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319886976:12345-0@lo:400:kworker.0 Request processed in 27us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947441.212708:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783947441.212889:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319886976:0@lo:400:kworker.0 00000100:00100000:2.0:1783947441.212900:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319887360:0@lo:400:kworker.0 00000100:00100000:1.0:1783947441.212977:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319886848 00000100:00100000:1.0:1783947441.212981:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319886848 00000100:00100000:1.0:1783947441.213026:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783947441.213034:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319886848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783947441.213061:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783947441.213102:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319886848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947441.213119:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1783947441.213156:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c85c30a80 x1870604319886848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947441.213173:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319886848:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783947441.213193:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947441.213392:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319887488 00000100:00100000:0.0:1783947441.213397:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319887488 00000100:00100000:0.0:1783947441.213609:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783947441.213617:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83373100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319887488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947441.213660:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83373100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319887488:12345-0@lo:400:kworker.0 Request processed in 44us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947441.213667:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1783947441.214078:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783947441.214105:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd97c380 x1870604319887488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947441.214117:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319887488:0@lo:400:kworker.0 00010000:00010000:2.0:1783947441.468669:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947441.722994:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319887616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947441.723061:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947441.723167:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319887616 00000100:00100000:2.0:1783947441.723176:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319887616 00000100:00100000:2.0:1783947441.723226:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783947441.723236:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319887616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783947441.723269:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947441.723334:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319887616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947441.723342:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1783947441.723379:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd039500 x1870604319887616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947441.723398:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319887616:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783947442.489752:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947443.516038:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947444.544579:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947445.002281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947445.002346:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947445.002494:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297837312 00000100:00100000:0.0:1783947445.002503:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297837312 00000100:00100000:0.0:1783947445.002566:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 192 00000100:00100000:0.0:1783947445.002576:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+10:2354:x1870604297837312:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947445.002646:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+10:2354:x1870604297837312:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 72us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947445.002654:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 192 00000100:00100000:2.0:1783947445.003093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947445.003473:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947445.003504:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297837568 00000100:00100000:2.0:1783947445.003510:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297837568 00000100:00100000:2.0:1783947445.003618:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297837696 00000100:00100000:2.0:1783947445.003621:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297837696 00000100:00100000:2.0:1783947445.003647:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:2.0:1783947445.003655:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297837568:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947445.003700:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297837568:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 46us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947445.003708:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:2.0:1783947445.003723:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:2.0:1783947445.003728:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297837696:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947445.003752:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297837696:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 24us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947445.003757:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:0.0:1783947445.004002:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297837440 00000100:00100000:0.0:1783947445.004007:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297837440 00000100:00100000:0.0:1783947445.004046:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:0.0:1783947445.004054:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297837440:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947445.004084:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297837440:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 32us (1694us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947445.004102:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00080000:2.0:1783947445.004366:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783947445.004371:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783947445.004373:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783947445.561717:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947446.332218:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319888128:0@lo:400:kworker.0 00000100:00100000:3.0:1783947446.332289:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947446.332359:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783947446.332366:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319887744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947446.332392:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947446.332447:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319888256:0@lo:400:kworker.0 00000100:00100000:3.0:1783947446.332945:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947446.332998:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319887872:0@lo:400:kworker.0 00000100:00100000:3.0:1783947446.333029:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947446.333051:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319888384:0@lo:400:kworker.0 00000100:00100000:3.0:1783947446.333141:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947446.333164:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783947446.333171:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319888000:0@lo:400:kworker.0 00000100:00100000:3.0:1783947446.333192:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947446.333221:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319888512:0@lo:400:kworker.0 00000100:00100000:3.0:1783947446.333258:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947446.333294:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319888128 00000100:00100000:3.0:1783947446.333302:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319888128 00000100:00100000:3.0:1783947446.334148:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319888384 00000100:00100000:3.0:1783947446.334155:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319888384 00000100:00100000:3.0:1783947446.334185:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319888000 00000100:00100000:3.0:1783947446.334188:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319888000 00000100:00100000:3.0:1783947446.334206:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783947446.334215:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319888128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947446.334338:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319888128:12345-0@lo:400:kworker.0 Request processed in 124us (2049us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947446.334345:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783947446.334371:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783947446.334378:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319888384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947446.334413:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319888384:12345-0@lo:400:kworker.0 Request processed in 35us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947446.334445:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783947446.334465:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783947446.334472:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319888000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947446.334500:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319888000:12345-0@lo:400:kworker.0 Request processed in 29us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947446.334516:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783947446.334535:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319887744 00000100:00100000:3.0:1783947446.334540:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319887744 00000100:00100000:3.0:1783947446.334568:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783947446.334575:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319887744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947446.334602:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783947446.334633:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319887744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (2240us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947446.334640:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783947446.334659:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319888256 00000100:00100000:3.0:1783947446.334663:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319888256 00000100:00100000:3.0:1783947446.334689:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319888512 00000100:00100000:3.0:1783947446.334692:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319888512 00000100:00100000:3.0:1783947446.334713:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783947446.334719:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319888256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947446.334749:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319888256:12345-0@lo:400:kworker.0 Request processed in 31us (1805us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947446.334755:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783947446.334765:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783947446.334771:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319888512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947446.334798:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319888512:12345-0@lo:400:kworker.0 Request processed in 28us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947446.334804:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783947446.334820:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319887872 00000100:00100000:3.0:1783947446.334824:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319887872 00000100:00100000:3.0:1783947446.334858:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1783947446.334865:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319887872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947446.334905:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319887872:12345-0@lo:400:kworker.0 Request processed in 41us (1875us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947446.334911:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:3.0:1783947446.334952:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947446.334967:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783947446.334969:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947446.335016:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319888000:0@lo:400:kworker.0 00010000:00080000:3.0:1783947446.335031:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c85c30000 x1870604319888512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947446.335041:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319888512:0@lo:400:kworker.0 00000100:00100000:3.0:1783947446.335051:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319887872:0@lo:400:kworker.0 00000100:00100000:3.0:1783947446.335060:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319888384:0@lo:400:kworker.0 00000100:00100000:1.0:1783947446.340664:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319888128:0@lo:400:kworker.0 00010000:00080000:1.0:1783947446.340701:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c85c31500 x1870604319887744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947446.340722:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319887744:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1783947446.340734:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c85c32a00 x1870604319888256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947446.340743:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319888256:0@lo:400:kworker.0 00010000:00010000:3.0:1783947446.586986:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947446.843180:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947446.843205:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319888640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947446.843272:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947446.843305:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319888640 00000100:00100000:0.0:1783947446.843314:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319888640 00000100:00100000:0.0:1783947446.845033:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783947446.845054:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319888640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783947446.845784:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947446.848502:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319888640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3446us (5219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947446.848518:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1783947446.851537:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd97c380 x1870604319888640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947446.851564:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319888640:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1783947447.079816:0:8674:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1783947447.609878:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947448.636197:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947449.661687:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947450.131022:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947450.131078:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297838080 00000100:00100000:0.0:1783947450.131087:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297838080 00000100:00100000:0.0:1783947450.131165:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:0.0:1783947450.131176:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2352:x1870604297838080:12345-192.168.203.32@tcp:9:kworker.0 00000100:00080000:2.0:1783947450.131209:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1783947450.131219:0:6590:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1cf3 00000100:00080000:0.0:1783947450.131228:0:6590:0:(import.c:65:import_set_state_nolock()) ffff8b3cbd4d3000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783947450.131271:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1783947450.131301:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947450.131627:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+2:2352:x1870604297838080:12345-192.168.203.32@tcp:9:kworker.0 Request processed in 452us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947450.131635:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:2.0:1783947450.134489:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947450.134526:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947450.134577:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947450.134610:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297837952 00000100:00100000:2.0:1783947450.134619:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297837952 00000100:00100000:2.0:1783947450.134678:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:2.0:1783947450.134687:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2355:x1870604297837952:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947450.134759:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2355:x1870604297837952:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 73us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947450.134766:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00080000:2.0:1783947450.134792:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947450.135600:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297838208 00000100:00100000:3.0:1783947450.135608:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297838208 00000100:00100000:3.0:1783947450.135674:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:3.0:1783947450.135685:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2352:x1870604297838208:12345-192.168.203.32@tcp:9:kworker.0 00000020:00000080:3.0:1783947450.135719:0:8151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1cfa 00000100:00080000:3.0:1783947450.135730:0:8151:0:(import.c:65:import_set_state_nolock()) ffff8b3cbd4d0000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783947450.135768:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297837824 00000001:00000004:3.0:1783947450.135769:0:8151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1783947450.135775:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297837824 00000100:00100000:0.0:1783947450.135831:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 194 00000100:00100000:0.0:1783947450.135840:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+10:2355:x1870604297837824:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947450.135906:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+10:2355:x1870604297837824:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 67us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947450.135915:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 194 00010000:00010000:0.0:1783947450.135960:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783947450.136458:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947450.136579:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+2:2352:x1870604297838208:12345-192.168.203.32@tcp:9:kworker.0 Request processed in 895us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947450.136589:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00010000:00010000:3.0:1783947450.683176:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947451.452340:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319888768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947451.452410:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947451.452505:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319888768 00000100:00100000:3.0:1783947451.452512:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319888768 00000100:00100000:3.0:1783947451.452566:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783947451.452575:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319888768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947451.452611:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783947451.452654:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319888768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947451.452661:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1783947451.452682:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783947451.452710:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b85dace00 x1870604319888768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947451.452727:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319888768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947451.453450:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319888896:0@lo:400:kworker.0 00000100:00100000:3.0:1783947451.453496:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947451.453523:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319889408:0@lo:400:kworker.0 00000100:00100000:3.0:1783947451.453547:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947451.453571:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947451.453576:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319889024:0@lo:400:kworker.0 00000100:00100000:3.0:1783947451.453600:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947451.453631:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319889408 00000100:00100000:3.0:1783947451.453636:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319889408 00000100:00100000:3.0:1783947451.453678:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783947451.453685:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319889408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947451.453737:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319889408:12345-0@lo:400:kworker.0 Request processed in 51us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947451.453744:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783947451.453763:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319889024 00000100:00100000:3.0:1783947451.453766:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319889024 00000100:00100000:3.0:1783947451.453789:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783947451.453795:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319889024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947451.453822:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319889024:12345-0@lo:400:kworker.0 Request processed in 27us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947451.453827:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783947451.453850:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319889152:0@lo:400:kworker.0 00000100:00100000:3.0:1783947451.453874:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947451.453893:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947451.453899:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319889280:0@lo:400:kworker.0 00000100:00100000:3.0:1783947451.453929:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947451.453953:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319889152 00000100:00100000:3.0:1783947451.453957:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319889152 00000100:00100000:3.0:1783947451.453978:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319889280 00000100:00100000:3.0:1783947451.453981:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319889280 00000100:00100000:3.0:1783947451.453999:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783947451.454004:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319889152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947451.454033:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319889152:12345-0@lo:400:kworker.0 Request processed in 29us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947451.454039:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783947451.454048:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783947451.454053:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319889280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947451.454172:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319888896 00000100:00100000:1.0:1783947451.454176:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319888896 00000100:00100000:1.0:1783947451.454200:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1783947451.454206:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319888896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947451.456265:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319888896:12345-0@lo:400:kworker.0 Request processed in 2050us (2759us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947451.456279:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1783947451.456664:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319889280:12345-0@lo:400:kworker.0 Request processed in 2609us (2743us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947451.456674:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1783947451.456702:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947451.456707:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947451.456740:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319889280:0@lo:400:kworker.0 00000100:00100000:3.0:1783947451.456751:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319889152:0@lo:400:kworker.0 00000100:00100000:3.0:1783947451.456781:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319889024:0@lo:400:kworker.0 00000100:00100000:3.0:1783947451.456789:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319888896:0@lo:400:kworker.0 00010000:00080000:3.0:1783947451.456802:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b85da8e00 x1870604319889408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947451.456813:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319889408:0@lo:400:kworker.0 00010000:00010000:3.0:1783947451.706631:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947451.961557:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319889536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947451.961628:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947451.961700:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319889536 00000100:00100000:2.0:1783947451.961708:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319889536 00000100:00100000:2.0:1783947451.961906:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783947451.961927:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319889536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783947451.961961:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947451.962002:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319889536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947451.962009:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1783947451.962056:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b86507100 x1870604319889536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947451.962078:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319889536:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1783947452.038007:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d1ed966c-3190-4795-821d-ae5dca7b5f51 00000020:00000080:0.0:1783947452.038018:0:6616:0:(genops.c:906:class_export_put()) final put ffff8b3cbd4d4800/d1ed966c-3190-4795-821d-ae5dca7b5f51 00000020:00000080:1.0:1783947452.038124:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cbd4d4800/d1ed966c-3190-4795-821d-ae5dca7b5f51 for lustre-OST0000 00000020:00000080:1.0:1783947452.038182:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3cbd4d3000 for lustre-OST0000 00010000:00010000:3.0:1783947452.735349:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783947453.001556:0:8918:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing yml_node 00010000:00010000:1.0:1783947453.753515:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783947454.595513:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d1ed966c-3190-4795-821d-ae5dca7b5f51 00000020:00000080:2.0:1783947454.595521:0:7509:0:(genops.c:906:class_export_put()) final put ffff8b3cbd4d4000/d1ed966c-3190-4795-821d-ae5dca7b5f51 00000020:00000080:2.0:1783947454.595559:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cbd4d4000/d1ed966c-3190-4795-821d-ae5dca7b5f51 for lustre-OST0001 00000020:00000080:2.0:1783947454.595605:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3cbd4d0000 for lustre-OST0001 00010000:00010000:3.0:1783947454.777663:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947455.244555:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947455.244603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947455.244693:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297838464 00000100:00100000:3.0:1783947455.244704:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297838464 00000100:00100000:3.0:1783947455.244784:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:3.0:1783947455.244794:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297838464:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947455.244872:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297838464:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 79us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947455.244879:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:0.0:1783947455.245397:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297838336 00000100:00100000:0.0:1783947455.245402:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297838336 00000100:00100000:0.0:1783947455.245479:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 196 00000100:00100000:0.0:1783947455.245488:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+10:2354:x1870604297838336:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947455.245522:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+10:2354:x1870604297838336:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 36us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947455.245529:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 196 00000100:00080000:1.0:1783947455.246352:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783947455.801670:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947456.569736:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319890048:0@lo:400:kworker.0 00000100:00100000:2.0:1783947456.569800:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947456.569857:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947456.569862:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319889920:0@lo:400:kworker.0 00000100:00100000:0.0:1783947456.569918:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319889792:0@lo:400:kworker.0 00000100:00100000:0.0:1783947456.569949:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947456.569963:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319890304:0@lo:400:kworker.0 00000100:00100000:0.0:1783947456.569979:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947456.569991:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783947456.569996:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319889664:0@lo:400:kworker.0 00000100:00100000:0.0:1783947456.570016:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947456.570053:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319890176:0@lo:400:kworker.0 00000100:00100000:0.0:1783947456.570071:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947456.570094:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319889664 00000100:00100000:0.0:1783947456.570101:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319889664 00000100:00100000:0.0:1783947456.570149:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1783947456.570170:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319889664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947456.570218:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319889664:12345-0@lo:400:kworker.0 Request processed in 49us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947456.570225:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1783947456.570286:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319889664:0@lo:400:kworker.0 00000100:00100000:2.0:1783947456.570472:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947456.570656:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319889792 00000100:00100000:0.0:1783947456.570661:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319889792 00000100:00100000:0.0:1783947456.570690:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319890176 00000100:00100000:0.0:1783947456.570692:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319890176 00000100:00100000:0.0:1783947456.570711:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319889920 00000100:00100000:0.0:1783947456.570713:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319889920 00000100:00100000:0.0:1783947456.570726:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783947456.570731:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319889792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947456.570777:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319889792:12345-0@lo:400:kworker.0 Request processed in 46us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947456.570794:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783947456.570805:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783947456.570810:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319890176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947456.570833:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319890176:12345-0@lo:400:kworker.0 Request processed in 23us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947456.570839:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783947456.570847:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783947456.570851:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319889920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947456.570875:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319889920:12345-0@lo:400:kworker.0 Request processed in 24us (404us total) trans 0 rc 0/0 00000100:00080000:1.0:1783947456.570919:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947456.570952:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319890176:0@lo:400:kworker.0 00000100:00100000:1.0:1783947456.570960:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319889792:0@lo:400:kworker.0 00000100:00100000:1.0:1783947456.570985:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319889920:0@lo:400:kworker.0 00000100:00100000:0.0:1783947456.571140:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783947456.571312:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319890048 00000100:00100000:3.0:1783947456.571318:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319890048 00000100:00100000:3.0:1783947456.571364:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319890304 00000100:00100000:3.0:1783947456.571367:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319890304 00000100:00100000:3.0:1783947456.571386:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783947456.571393:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319890048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947456.571454:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319890048:12345-0@lo:400:kworker.0 Request processed in 61us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947456.571460:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783947456.571473:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783947456.571479:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319890304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947456.571511:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319890304:12345-0@lo:400:kworker.0 Request processed in 32us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947456.571516:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1783947456.571558:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b86505c00 x1870604319890048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947456.571569:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319890048:0@lo:400:kworker.0 00010000:00080000:3.0:1783947456.571588:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b86505180 x1870604319890304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947456.571597:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319890304:0@lo:400:kworker.0 00000100:00080000:1.0:1783947456.571650:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947456.571654:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947456.572977:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319890432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947456.573050:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947456.573188:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319890432 00000100:00100000:2.0:1783947456.573197:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319890432 00000100:00100000:2.0:1783947456.573245:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783947456.573253:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85da9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319890432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947456.573287:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947456.573343:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85da9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319890432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947456.573350:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1783947456.573456:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cb6aef100 x1870604319890432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947456.573473:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319890432:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783947456.825670:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947457.081675:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319890560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947457.081747:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947457.081876:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319890560 00000100:00100000:2.0:1783947457.081893:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319890560 00000100:00100000:2.0:1783947457.081946:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783947457.081954:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319890560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783947457.081987:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1783947457.082189:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b86507480 x1870604319890560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947457.082206:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319890560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947457.082353:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319890560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947457.082363:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1783947457.859140:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783947458.062280:0:9111:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.162 00010000:00010000:3.0:1783947458.873746:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947459.897586:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947460.359008:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947460.359081:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947460.359116:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297838592 00000100:00100000:1.0:1783947460.359128:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297838592 00000100:00100000:1.0:1783947460.359191:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 198 00000100:00100000:1.0:1783947460.359202:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+10:2355:x1870604297838592:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947460.359287:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+10:2355:x1870604297838592:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 88us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947460.359314:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 198 00000100:00100000:1.0:1783947460.361346:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297838720 00000100:00100000:1.0:1783947460.361368:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297838720 00000100:00100000:1.0:1783947460.361504:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:1.0:1783947460.361518:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2355:x1870604297838720:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947460.361624:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2355:x1870604297838720:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 110us (2633us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947460.361633:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00080000:2.0:1783947460.366396:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783947460.921966:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783947461.084032:0:9209:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.162 00000100:00100000:0.0:1783947461.700112:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319890688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947461.700183:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947461.700629:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319890688 00000100:00100000:2.0:1783947461.700638:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319890688 00000100:00100000:2.0:1783947461.700700:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783947461.700710:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319890688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947461.700746:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947461.700803:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319890688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947461.700810:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783947461.700951:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85da8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319890944:0@lo:400:kworker.0 00000100:00100000:1.0:1783947461.700990:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947461.701015:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947461.701021:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319891072:0@lo:400:kworker.0 00000100:00100000:1.0:1783947461.701042:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947461.701088:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319890944 00000100:00100000:1.0:1783947461.701092:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319890944 00000100:00100000:1.0:1783947461.701118:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319891072 00000100:00100000:1.0:1783947461.701121:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319891072 00000100:00100000:1.0:1783947461.701140:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783947461.701146:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319890944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947461.701180:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319890944:12345-0@lo:400:kworker.0 Request processed in 35us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947461.701186:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783947461.701197:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783947461.701202:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319891072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947461.701224:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319891072:12345-0@lo:400:kworker.0 Request processed in 22us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947461.701240:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783947461.701266:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319890816:0@lo:400:kworker.0 00000100:00100000:1.0:1783947461.701296:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947461.701315:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85da8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319891328:0@lo:400:kworker.0 00000100:00100000:1.0:1783947461.701338:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947461.701357:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947461.701362:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85da8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319891200:0@lo:400:kworker.0 00000100:00100000:1.0:1783947461.701382:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947461.701403:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319891328 00000100:00100000:1.0:1783947461.701406:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319891328 00000100:00100000:1.0:1783947461.701475:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783947461.701482:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319891328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947461.701515:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319891328:12345-0@lo:400:kworker.0 Request processed in 34us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947461.701521:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783947461.701555:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319891072:0@lo:400:kworker.0 00000100:00100000:1.0:1783947461.701566:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85da8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319890944:0@lo:400:kworker.0 00010000:00080000:1.0:1783947461.701592:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b85da8a80 x1870604319891328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947461.701601:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85da8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319891328:0@lo:400:kworker.0 00000100:00100000:1.0:1783947461.701613:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319891200 00000100:00100000:1.0:1783947461.701616:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319891200 00000100:00100000:1.0:1783947461.701637:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783947461.701642:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319891200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947461.701681:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319891200:12345-0@lo:400:kworker.0 Request processed in 37us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947461.701686:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783947461.701713:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85da8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319891200:0@lo:400:kworker.0 00000100:00080000:0.0:1783947461.701867:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783947461.701873:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947461.701875:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947461.701886:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319890816 00000100:00100000:0.0:1783947461.701890:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319890816 00000100:00100000:0.0:1783947461.701928:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1783947461.701935:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319890816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947461.701970:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319890816:12345-0@lo:400:kworker.0 Request processed in 35us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947461.701976:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00010000:00080000:0.0:1783947461.702017:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cb6aef100 x1870604319890688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947461.702033:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319890688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947461.702099:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319890816:0@lo:400:kworker.0 00010000:00010000:1.0:1783947461.946533:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947462.217038:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947462.217069:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319891456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947462.217146:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947462.217327:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319891456 00000100:00100000:2.0:1783947462.217335:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319891456 00000100:00100000:2.0:1783947462.217387:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947462.217396:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319891456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783947462.217452:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947462.217506:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319891456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947462.217513:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1783947462.217601:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b86505500 x1870604319891456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947462.217620:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319891456:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783947462.970538:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947463.993691:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783947464.233684:0:9307:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.162 00010000:00010000:3.0:1783947465.019897:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947465.481965:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947465.482022:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947465.482081:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297838976 00000100:00100000:2.0:1783947465.482092:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297838976 00000100:00100000:2.0:1783947465.482189:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:2.0:1783947465.482200:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2355:x1870604297838976:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947465.482277:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2355:x1870604297838976:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 79us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947465.482284:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:0.0:1783947465.482331:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297838848 00000100:00100000:0.0:1783947465.482337:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297838848 00000100:00100000:0.0:1783947465.482372:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 200 00000100:00100000:0.0:1783947465.482387:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+10:2355:x1870604297838848:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947465.482466:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+10:2355:x1870604297838848:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 87us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947465.482474:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 200 00000100:00080000:3.0:1783947465.482743:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783947466.043681:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783947466.440520:0:9355:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Jul 13 08:57:43 EDT 2026 00000100:00100000:1.0:1783947466.809864:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319891584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947466.809955:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947466.810156:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319891584 00000100:00100000:3.0:1783947466.810165:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319891584 00000100:00100000:3.0:1783947466.810228:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783947466.810237:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85da8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319891584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947466.810271:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783947466.810317:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85da8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319891584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947466.810325:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783947466.810510:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319891712:0@lo:400:kworker.0 00000100:00100000:3.0:1783947466.810541:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947466.810569:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319892224:0@lo:400:kworker.0 00000100:00100000:3.0:1783947466.810592:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947466.810612:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947466.810617:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319891840:0@lo:400:kworker.0 00000100:00100000:3.0:1783947466.810640:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947466.810681:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319892224 00000100:00100000:3.0:1783947466.810685:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319892224 00000100:00100000:3.0:1783947466.810716:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783947466.810722:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319892224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947466.810759:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319892224:12345-0@lo:400:kworker.0 Request processed in 36us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947466.810765:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1783947466.810825:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c84f52300 x1870604319892224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947466.810839:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319892224:0@lo:400:kworker.0 00000100:00080000:1.0:1783947466.811100:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947466.811104:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947466.811122:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319891840 00000100:00100000:1.0:1783947466.811126:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319891840 00000100:00100000:1.0:1783947466.811165:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783947466.811173:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319891840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947466.811215:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319891840:12345-0@lo:400:kworker.0 Request processed in 43us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947466.811221:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783947466.811240:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319892096:0@lo:400:kworker.0 00000100:00100000:1.0:1783947466.811265:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783947466.811291:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c84f53100 x1870604319891584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947466.811306:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319891584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947466.811324:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947466.811329:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319891968:0@lo:400:kworker.0 00000100:00100000:1.0:1783947466.811352:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947466.811375:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319892096 00000100:00100000:1.0:1783947466.811379:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319892096 00000100:00100000:1.0:1783947466.811403:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319891968 00000100:00100000:1.0:1783947466.811405:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319891968 00000100:00100000:1.0:1783947466.811451:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783947466.811458:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319892096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947466.811491:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319892096:12345-0@lo:400:kworker.0 Request processed in 34us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947466.811497:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783947466.811508:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783947466.811514:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85da8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319891968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947466.811540:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85da8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319891968:12345-0@lo:400:kworker.0 Request processed in 27us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947466.811546:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1783947466.811562:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947466.811581:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319891840:0@lo:400:kworker.0 00000100:00100000:1.0:1783947466.811601:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319891968:0@lo:400:kworker.0 00000100:00100000:1.0:1783947466.811609:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319892096:0@lo:400:kworker.0 00000100:00100000:0.0:1783947466.811785:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319891712 00000100:00100000:0.0:1783947466.811790:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319891712 00000100:00100000:0.0:1783947466.811834:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1783947466.811841:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3311:x1870604319891712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947466.811877:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3311:x1870604319891712:12345-0@lo:400:kworker.0 Request processed in 37us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947466.811883:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1783947466.812301:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319891712:0@lo:400:kworker.0 00010000:00010000:3.0:1783947467.066384:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947467.322536:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319892352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947467.322628:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947467.322970:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319892352 00000100:00100000:0.0:1783947467.322979:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319892352 00000100:00100000:0.0:1783947467.323027:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783947467.323037:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319892352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783947467.323082:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947467.323136:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319892352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947467.323143:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1783947467.324251:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b85da9180 x1870604319892352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947467.324276:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319892352:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783947468.091617:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947469.115553:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947470.141899:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947470.596517:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947470.596557:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947470.596637:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297839104 00000100:00100000:0.0:1783947470.596646:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297839104 00000100:00100000:0.0:1783947470.596689:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 202 00000100:00100000:0.0:1783947470.596697:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+10:2355:x1870604297839104:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947470.596764:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+10:2355:x1870604297839104:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 68us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947470.596771:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 202 00000100:00100000:3.0:1783947470.597481:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297839232 00000100:00100000:3.0:1783947470.597489:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297839232 00000100:00100000:3.0:1783947470.597714:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00100000:3.0:1783947470.597723:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2355:x1870604297839232:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947470.597781:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2355:x1870604297839232:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 59us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947470.597799:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00080000:0.0:1783947470.599880:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783947471.161558:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947471.930382:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947471.930405:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319892480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947471.930490:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947471.930603:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319892480 00000100:00100000:0.0:1783947471.930611:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319892480 00000100:00100000:0.0:1783947471.930674:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783947471.930685:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319892480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947471.930723:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947471.930773:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319892480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947471.930803:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1783947471.930809:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c84f50700 x1870604319892480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947471.930831:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319892480:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783947471.930922:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947471.931287:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319892992:0@lo:400:kworker.0 00000100:00100000:3.0:1783947471.931323:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947471.931350:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783947471.931356:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319892608:0@lo:400:kworker.0 00000100:00100000:3.0:1783947471.931383:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947471.931407:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319893120:0@lo:400:kworker.0 00000100:00100000:3.0:1783947471.931452:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947471.931479:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319892608 00000100:00100000:3.0:1783947471.931483:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319892608 00000100:00100000:3.0:1783947471.931528:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1783947471.931535:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319892608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947471.931572:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319892608:12345-0@lo:400:kworker.0 Request processed in 38us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947471.931579:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1783947471.931606:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319893120 00000100:00100000:3.0:1783947471.931609:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319893120 00000100:00100000:3.0:1783947471.931641:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783947471.931649:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85daf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319893120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947471.931681:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85daf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319893120:12345-0@lo:400:kworker.0 Request processed in 33us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947471.931687:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1783947471.931707:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947471.931726:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319892608:0@lo:400:kworker.0 00010000:00080000:3.0:1783947471.931738:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b85dab100 x1870604319893120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947471.931748:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319893120:0@lo:400:kworker.0 00000100:00100000:1.0:1783947471.931940:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319892992 00000100:00100000:1.0:1783947471.931944:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319892992 00000100:00100000:1.0:1783947471.931991:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783947471.931998:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319892992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947471.932046:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319892992:12345-0@lo:400:kworker.0 Request processed in 48us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947471.932051:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783947471.932174:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85daaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319892736:0@lo:400:kworker.0 00000100:00100000:0.0:1783947471.932205:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947471.932232:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947471.932238:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319892864:0@lo:400:kworker.0 00000100:00100000:0.0:1783947471.932259:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947471.932320:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319892736 00000100:00100000:3.0:1783947471.932324:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319892736 00000100:00100000:3.0:1783947471.932355:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319892864 00000100:00100000:3.0:1783947471.932358:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319892864 00000100:00100000:3.0:1783947471.932374:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783947471.932380:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319892736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947471.932439:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319892736:12345-0@lo:400:kworker.0 Request processed in 38us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947471.932446:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783947471.932467:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783947471.932473:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319892864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947471.932502:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319892864:12345-0@lo:400:kworker.0 Request processed in 29us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947471.932508:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1783947471.932522:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947471.932541:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319892864:0@lo:400:kworker.0 00000100:00100000:3.0:1783947471.932549:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85daaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319892736:0@lo:400:kworker.0 00000100:00100000:3.0:1783947471.932572:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319892992:0@lo:400:kworker.0 00010000:00010000:2.0:1783947472.185737:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947472.443911:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783947472.443942:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319893248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947472.444018:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947472.454532:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319893248 00000100:00100000:3.0:1783947472.454548:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319893248 00000100:00100000:3.0:1783947472.454611:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783947472.454622:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319893248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783947472.454659:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783947472.454746:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319893248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (10727us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947472.454754:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1783947472.455397:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b85da9880 x1870604319893248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947472.455452:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319893248:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783947473.213317:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947474.236140:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947475.258839:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947475.724956:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947475.725009:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947475.725041:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297839488 00000100:00100000:2.0:1783947475.725050:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297839488 00000100:00100000:2.0:1783947475.725127:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:2.0:1783947475.725137:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297839488:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947475.725226:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297839488:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 90us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947475.725233:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00080000:2.0:1783947475.725256:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947475.725467:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297839360 00000100:00100000:3.0:1783947475.725472:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297839360 00000100:00100000:3.0:1783947475.725571:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 204 00000100:00100000:3.0:1783947475.725580:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+10:2354:x1870604297839360:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947475.725619:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+10:2354:x1870604297839360:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 41us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947475.725625:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 204 00010000:00010000:3.0:1783947476.281624:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947477.051551:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783947477.051576:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319893376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947477.051639:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947477.051701:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319893376 00000100:00100000:2.0:1783947477.051707:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319893376 00000100:00100000:2.0:1783947477.051769:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783947477.051777:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319893376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947477.051809:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947477.051846:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319893376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947477.051853:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1783947477.051873:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783947477.051915:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b86505c00 x1870604319893376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947477.051931:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319893376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947477.052146:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870604319893632:0@lo:400:kworker.0 00000100:00100000:2.0:1783947477.052173:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947477.052196:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783947477.052203:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319893504:0@lo:400:kworker.0 00000100:00100000:2.0:1783947477.052228:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947477.052248:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319894016:0@lo:400:kworker.0 00000100:00100000:2.0:1783947477.052279:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947477.052303:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319893888:0@lo:400:kworker.0 00000100:00100000:2.0:1783947477.052324:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947477.052340:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783947477.052344:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1870604319893760:0@lo:400:kworker.0 00000100:00100000:2.0:1783947477.052362:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947477.052398:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319893632 00000100:00100000:2.0:1783947477.052402:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319893632 00000100:00100000:2.0:1783947477.052449:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319893888 00000100:00100000:2.0:1783947477.052453:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319893888 00000100:00100000:2.0:1783947477.052471:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319893760 00000100:00100000:2.0:1783947477.052474:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319893760 00000100:00100000:2.0:1783947477.052488:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783947477.052493:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870604319893632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947477.052530:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870604319893632:12345-0@lo:400:kworker.0 Request processed in 36us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947477.052536:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783947477.052549:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783947477.052555:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319893888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947477.052584:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319893888:12345-0@lo:400:kworker.0 Request processed in 29us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947477.052589:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783947477.052601:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783947477.052607:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870604319893760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947477.052631:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870604319893760:12345-0@lo:400:kworker.0 Request processed in 25us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947477.052637:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783947477.052661:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319893504 00000100:00100000:2.0:1783947477.052665:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319893504 00000100:00100000:2.0:1783947477.052687:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1783947477.052693:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319893504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947477.052722:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319893504:12345-0@lo:400:kworker.0 Request processed in 29us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947477.052727:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1783947477.052763:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319894016 00000100:00100000:2.0:1783947477.052767:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319894016 00000100:00100000:2.0:1783947477.052792:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783947477.052798:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319894016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947477.052826:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319894016:12345-0@lo:400:kworker.0 Request processed in 28us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947477.052831:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1783947477.052859:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783947477.052862:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947477.052882:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1870604319893760:0@lo:400:kworker.0 00000100:00100000:2.0:1783947477.052892:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319893888:0@lo:400:kworker.0 00000100:00100000:2.0:1783947477.052915:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319893504:0@lo:400:kworker.0 00010000:00080000:2.0:1783947477.052925:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd441880 x1870604319894016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947477.052934:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319894016:0@lo:400:kworker.0 00000100:00100000:2.0:1783947477.052944:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870604319893632:0@lo:400:kworker.0 00010000:00010000:0.0:1783947477.305722:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947477.562626:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319894144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947477.562707:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947477.562794:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319894144 00000100:00100000:3.0:1783947477.562802:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319894144 00000100:00100000:3.0:1783947477.562849:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783947477.562870:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319894144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783947477.562903:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783947477.562949:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319894144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947477.562957:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1783947477.562999:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b85dae680 x1870604319894144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947477.563018:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319894144:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783947478.333993:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947479.355034:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947480.377637:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947480.839856:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947480.839911:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947480.840070:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297839744 00000100:00100000:0.0:1783947480.840081:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297839744 00000100:00100000:0.0:1783947480.840162:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00100000:0.0:1783947480.840174:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2353:x1870604297839744:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947480.840257:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2353:x1870604297839744:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 84us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947480.840265:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00080000:2.0:1783947480.840601:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947480.842586:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297839616 00000100:00100000:3.0:1783947480.842895:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297839616 00000100:00100000:3.0:1783947480.843406:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 206 00000100:00100000:3.0:1783947480.843465:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+10:2353:x1870604297839616:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947480.843549:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+10:2353:x1870604297839616:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 134us (3638us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947480.843557:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 206 00010000:00010000:2.0:1783947481.401909:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947482.169861:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319894400:0@lo:400:kworker.0 00000100:00100000:0.0:1783947482.170009:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947482.171227:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947482.171242:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319894272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947482.171303:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947482.171350:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319894272 00000100:00100000:0.0:1783947482.171357:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319894272 00000100:00100000:0.0:1783947482.171414:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783947482.171442:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319894272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947482.171479:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947482.171524:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319894272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947482.171531:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1783947482.171583:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd440380 x1870604319894272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947482.171602:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319894272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947482.175869:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319894400 00000100:00100000:1.0:1783947482.175886:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319894400 00000100:00100000:1.0:1783947482.175954:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1783947482.175965:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319894400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947482.176062:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319894400:12345-0@lo:400:kworker.0 Request processed in 99us (6053us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947482.176070:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1783947482.176132:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319894400:0@lo:400:kworker.0 00000100:00100000:1.0:1783947482.178272:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1783947482.178288:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947482.178378:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85daea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319894528:0@lo:400:kworker.0 00000100:00100000:2.0:1783947482.178476:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319894656:0@lo:400:kworker.0 00000100:00100000:0.0:1783947482.179259:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947482.179278:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85daf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319894912:0@lo:400:kworker.0 00000100:00100000:3.0:1783947482.179286:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947482.179345:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947482.179383:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319894528 00000100:00100000:3.0:1783947482.179393:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319894528 00000100:00100000:3.0:1783947482.179499:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783947482.179509:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319894528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947482.180301:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947482.180400:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319894656 00000100:00100000:0.0:1783947482.180408:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319894656 00000100:00100000:0.0:1783947482.180516:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783947482.180528:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319894656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947482.180591:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319894656:12345-0@lo:400:kworker.0 Request processed in 67us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947482.180598:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1783947482.181152:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947482.181202:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319894656:0@lo:400:kworker.0 00000100:00100000:3.0:1783947482.181408:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319894528:12345-0@lo:400:kworker.0 Request processed in 1898us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947482.181445:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783947482.181471:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319894912 00000100:00100000:3.0:1783947482.181477:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319894912 00000100:00100000:0.0:1783947482.181936:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783947482.181954:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319894912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947482.182223:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319894912:12345-0@lo:400:kworker.0 Request processed in 270us (2876us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947482.182231:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1783947482.182271:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b85daf100 x1870604319894912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947482.182283:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85daf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319894912:0@lo:400:kworker.0 00000100:00080000:3.0:1783947482.183203:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947482.183358:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85daea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319894528:0@lo:400:kworker.0 00000100:00100000:0.0:1783947482.186114:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319894784:0@lo:400:kworker.0 00000100:00100000:0.0:1783947482.186258:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947482.187279:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319894784 00000100:00100000:2.0:1783947482.187290:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319894784 00000100:00100000:2.0:1783947482.187351:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783947482.187360:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319894784:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783947482.187450:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947482.187457:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319894784:12345-0@lo:400:kworker.0 Request processed in 98us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947482.187464:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783947482.187555:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319894784:0@lo:400:kworker.0 00010000:00010000:3.0:1783947482.428066:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947482.681622:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947482.681646:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319895040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947482.681724:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947482.681807:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319895040 00000100:00100000:1.0:1783947482.681815:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319895040 00000100:00100000:1.0:1783947482.681867:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783947482.681876:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85da9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319895040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947482.681911:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783947482.681960:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85da9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319895040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947482.681966:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1783947482.682042:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b85dac000 x1870604319895040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947482.682061:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319895040:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783947483.453465:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947484.473734:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783947485.239916:0:9985:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:58:02 (1783947482) === 00010000:00010000:1.0:1783947485.504352:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947485.882153:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947485.882214:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297839872 00000100:00100000:2.0:1783947485.882230:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297839872 00000100:00100000:2.0:1783947485.882326:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 208 00000100:00100000:2.0:1783947485.882345:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+10:8116:x1870604297839872:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783947485.882378:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947485.882409:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cc0630000/0x20c3e53e78bb1dbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aaf24 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947485.882490:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cc0630000/0x20c3e53e78bb1dbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf24 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947485.882543:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cc0630000/0x20c3e53e78bb1dbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf24 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947485.882555:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630000, rc 0) 00000100:00100000:2.0:1783947485.882639:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+11:8116:x1870604297839872:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 302us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947485.882648:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 208 00000100:00100000:2.0:1783947485.901274:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947485.904493:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297840000 00000100:00100000:1.0:1783947485.904517:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297840000 00000100:00100000:1.0:1783947485.904621:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 209 00000100:00100000:1.0:1783947485.904635:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+11:8116:x1870604297840000:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783947485.905267:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+11:8116:x1870604297840000:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 625us (4004us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947485.905282:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 209 00000100:00100000:0.0:1783947485.908475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947485.908861:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297840128 00000100:00100000:3.0:1783947485.908876:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297840128 00000100:00100000:3.0:1783947485.909085:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 210 00000100:00100000:3.0:1783947485.909101:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+11:8116:x1870604297840128:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783947485.911338:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+11:8116:x1870604297840128:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 2222us (2859us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947485.911360:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 210 00000100:00100000:0.0:1783947485.924618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947485.924969:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297840256 00000100:00100000:1.0:1783947485.924983:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297840256 00000100:00100000:1.0:1783947485.925663:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 211 00000100:00100000:1.0:1783947485.925691:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+11:8120:x1870604297840256:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783947485.926754:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+11:8120:x1870604297840256:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 1067us (2191us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947485.926770:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 211 00000100:00100000:1.0:1783947485.955485:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947485.955804:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297840384 00000100:00100000:3.0:1783947485.955819:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297840384 00000100:00100000:3.0:1783947485.955894:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 212 00000100:00100000:3.0:1783947485.955907:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+11:8120:x1870604297840384:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783947485.956289:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+11:8120:x1870604297840384:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 382us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947485.956299:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 212 00000100:00100000:0.0:1783947485.964365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947485.964973:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297840512 00000100:00100000:2.0:1783947485.964990:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297840512 00000100:00100000:2.0:1783947485.965112:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:2.0:1783947485.965126:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297840512:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947485.965234:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297840512:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 111us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947485.965242:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00080000:3.0:1783947485.967510:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947485.967723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947485.968270:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297840640 00000100:00100000:3.0:1783947485.968284:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297840640 00000100:00100000:3.0:1783947485.968362:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 213 00000100:00100000:3.0:1783947485.968374:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+11:8116:x1870604297840640:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783947485.968400:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947485.968473:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c8147da00/0x20c3e53e78bb1dc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aaf4e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947485.968509:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c8147da00/0x20c3e53e78bb1dc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf4e expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947485.968522:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c8147da00/0x20c3e53e78bb1dc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf4e expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947485.968533:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147da00, rc 0) 00000100:00100000:3.0:1783947485.968597:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+12:8116:x1870604297840640:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 225us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947485.968605:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 213 00000100:00100000:0.0:1783947485.972345:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947485.972847:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297840768 00000100:00100000:2.0:1783947485.972861:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297840768 00000100:00100000:2.0:1783947485.972945:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 214 00000100:00100000:2.0:1783947485.972957:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+12:8116:x1870604297840768:12345-192.168.203.32@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783947485.972997:0:5791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783947485.973036:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783947485.973041:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783947485.973045:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783947485.973047:0:5791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1783947485.980240:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+12:8116:x1870604297840768:12345-192.168.203.32@tcp:256:mount.lustre.0 Request processed in 7267us (7892us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947485.980406:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 214 00000100:00100000:1.0:1783947485.987039:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947485.989991:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297840896 00000100:00100000:0.0:1783947485.990016:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297840896 00000100:00100000:0.0:1783947485.990124:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 215 00000100:00100000:0.0:1783947485.990137:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+12:8116:x1870604297840896:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783947485.990161:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947485.990187:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c85670400/0x20c3e53e78bb1dcc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aaf55 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947485.990226:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c85670400/0x20c3e53e78bb1dcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf55 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947485.990262:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c85670400/0x20c3e53e78bb1dcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf55 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947485.990274:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670400, rc 0) 00000100:00100000:0.0:1783947485.990370:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+13:8116:x1870604297840896:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 235us (3347us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947485.990377:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 215 00000100:00100000:0.0:1783947485.994080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947485.994899:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297841024 00000100:00100000:3.0:1783947485.994916:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297841024 00000100:00100000:3.0:1783947485.994994:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 216 00000100:00100000:3.0:1783947485.995006:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:8116:x1870604297841024:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783947485.995494:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:8116:x1870604297841024:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 484us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947485.995513:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 216 00000100:00100000:2.0:1783947486.000307:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947486.001136:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297841152 00000100:00100000:3.0:1783947486.001153:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297841152 00000100:00100000:2.0:1783947486.001315:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 217 00000100:00100000:2.0:1783947486.001347:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:8116:x1870604297841152:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783947486.001695:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:8116:x1870604297841152:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 341us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947486.001704:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 217 00000100:00100000:1.0:1783947486.007865:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947486.008590:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297841280 00000100:00100000:0.0:1783947486.008606:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297841280 00000100:00100000:0.0:1783947486.008707:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 218 00000100:00100000:0.0:1783947486.008719:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+13:8126:x1870604297841280:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783947486.010662:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+13:8126:x1870604297841280:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 1929us (2808us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947486.010691:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 218 00000100:00100000:0.0:1783947486.015809:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947486.021895:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297841408 00000100:00100000:2.0:1783947486.021920:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297841408 00000100:00100000:2.0:1783947486.022036:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 219 00000100:00100000:2.0:1783947486.022049:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:8126:x1870604297841408:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783947486.022466:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:8126:x1870604297841408:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 417us (6683us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947486.022476:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 219 00000100:00100000:2.0:1783947486.028649:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947486.028939:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297841536 00000100:00100000:0.0:1783947486.028952:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297841536 00000100:00100000:0.0:1783947486.029028:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:0.0:1783947486.029038:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1870604297841536:12345-192.168.203.32@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783947486.029079:0:5795:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 1aaa8892-ac73-492b-a5e2-3055ae3e2dca@192.168.203.32@tcp t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:0.0:1783947486.029270:0:5795:0:(genops.c:1406:class_connect()) connect: client 1aaa8892-ac73-492b-a5e2-3055ae3e2dca, cookie 0x20c3e53e78bb1dd3 00000004:00100000:0.0:1783947486.029316:0:5795:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783947486.029772:0:5795:0:(import.c:65:import_set_state_nolock()) ffff8b3b8410d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947486.030252:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+6:2352:x1870604297841536:12345-192.168.203.32@tcp:38:mount.lustre.0 Request processed in 1208us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947486.030285:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:1.0:1783947486.031516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947486.031964:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297841920 00000100:00100000:2.0:1783947486.031978:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297841920 00000100:00100000:2.0:1783947486.032067:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:2.0:1783947486.032081:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85da8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2353:x1870604297841920:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947486.032207:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85da8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2353:x1870604297841920:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 128us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947486.032215:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:1.0:1783947486.036201:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947486.036254:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947486.036607:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297841664 00000100:00100000:2.0:1783947486.036620:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297841664 00000100:00100000:2.0:1783947486.036730:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297841792 00000100:00100000:2.0:1783947486.036734:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297841792 00000100:00100000:2.0:1783947486.036766:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:2.0:1783947486.036777:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+7:0:x1870604297841664:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783947486.036885:0:6613:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783947486.037012:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+7:0:x1870604297841664:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 236us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947486.037021:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:2.0:1783947486.037043:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:2.0:1783947486.037050:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85daad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+6:8116:x1870604297841792:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783947486.037063:0:6613:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783947486.037088:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85daad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+6:8116:x1870604297841792:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 38us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947486.037094:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00080000:3.0:1783947486.037187:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947486.039654:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947486.040540:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297842048 00000100:00100000:2.0:1783947486.040558:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297842048 00000100:00100000:2.0:1783947486.040655:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:2.0:1783947486.040668:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+6:8116:x1870604297842048:12345-192.168.203.32@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783947486.040821:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+6:8116:x1870604297842048:12345-192.168.203.32@tcp:40:mount.lustre.0 Request processed in 154us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947486.040829:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:1.0:1783947486.045617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947486.045954:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947486.046074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947486.046474:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297842432 00000100:00100000:0.0:1783947486.046497:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297842432 00000100:00100000:0.0:1783947486.046750:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:0.0:1783947486.046767:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+6:8116:x1870604297842432:12345-192.168.203.32@tcp:33:mount.lustre.0 00000100:00100000:2.0:1783947486.047493:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297842176 00000100:00100000:2.0:1783947486.047504:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297842176 00000100:00100000:3.0:1783947486.047567:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297842304 00000100:00100000:3.0:1783947486.047573:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297842304 00000100:00100000:3.0:1783947486.047611:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:3.0:1783947486.047631:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1870604297842176:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783947486.047674:0:6591:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 1aaa8892-ac73-492b-a5e2-3055ae3e2dca@192.168.203.32@tcp t0 exp 0000000000000000 cur 301 last 0 00000004:00200000:0.0:1783947486.047713:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000020:00000080:3.0:1783947486.047730:0:6591:0:(genops.c:1406:class_connect()) connect: client 1aaa8892-ac73-492b-a5e2-3055ae3e2dca, cookie 0x20c3e53e78bb1dda 00002000:00100000:3.0:1783947486.047749:0:6591:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1aaa8892-ac73-492b-a5e2-3055ae3e2dca/ffff8b3cb63ab000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783947486.047786:0:6591:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783947486.049237:0:6591:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783947486.049297:0:6591:0:(import.c:65:import_set_state_nolock()) ffff8b3cb63ad800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947486.049440:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+6:2352:x1870604297842176:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 1794us (3815us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947486.049453:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:3.0:1783947486.049498:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:3.0:1783947486.049506:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1870604297842304:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783947486.049537:0:6591:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 1aaa8892-ac73-492b-a5e2-3055ae3e2dca@192.168.203.32@tcp t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:3.0:1783947486.049570:0:6591:0:(genops.c:1406:class_connect()) connect: client 1aaa8892-ac73-492b-a5e2-3055ae3e2dca, cookie 0x20c3e53e78bb1de1 00002000:00100000:3.0:1783947486.049586:0:6591:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1aaa8892-ac73-492b-a5e2-3055ae3e2dca/ffff8b3cb63aa000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783947486.049610:0:6591:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1783947486.050054:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+6:8116:x1870604297842432:12345-192.168.203.32@tcp:33:mount.lustre.0 Request processed in 3282us (4090us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947486.050070:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00002000:00080000:3.0:1783947486.055368:0:6591:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783947486.055459:0:6591:0:(import.c:65:import_set_state_nolock()) ffff8b3cb63ad000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947486.055570:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+6:2352:x1870604297842304:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 6060us (9493us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947486.055585:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00010000:00010000:3.0:1783947486.523272:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947487.289765:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85daea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319895168:0@lo:400:kworker.0 00000100:00100000:3.0:1783947487.289767:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85daf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319895296:0@lo:400:kworker.0 00000100:00100000:0.0:1783947487.289836:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319895552:0@lo:400:kworker.0 00000100:00100000:3.0:1783947487.292605:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947487.292707:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319895296 00000100:00100000:2.0:1783947487.292719:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319895296 00000100:00100000:2.0:1783947487.292788:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783947487.292800:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319895296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947487.292879:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319895296:12345-0@lo:400:kworker.0 Request processed in 82us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947487.292908:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783947487.293478:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85daf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319895296:0@lo:400:kworker.0 00000100:00100000:3.0:1783947487.293495:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319895808:0@lo:400:kworker.0 00000100:00100000:3.0:1783947487.293540:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947487.293592:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783947487.293599:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319895424:0@lo:400:kworker.0 00000100:00100000:3.0:1783947487.293625:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947487.293652:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319895936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947487.293687:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947487.293734:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319895424 00000100:00100000:3.0:1783947487.293740:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319895424 00000100:00100000:3.0:1783947487.294109:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783947487.294120:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319895424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947487.294171:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319895424:12345-0@lo:400:kworker.0 Request processed in 54us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947487.294252:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1783947487.294279:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947487.294310:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319895424:0@lo:400:kworker.0 00000100:00100000:3.0:1783947487.294359:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319895936 00000100:00100000:3.0:1783947487.294379:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319895936 00000100:00100000:3.0:1783947487.294415:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783947487.294455:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319895936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947487.294476:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783947487.294518:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319895936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947487.294524:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1783947487.294543:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783947487.294562:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd440a80 x1870604319895936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947487.294581:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319895936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947487.295275:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319895808 00000100:00100000:2.0:1783947487.295285:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319895808 00000100:00100000:2.0:1783947487.295350:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783947487.295360:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319895808:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783947487.295379:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947487.295455:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319895808:12345-0@lo:400:kworker.0 Request processed in 97us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947487.295463:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1783947487.295470:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd97c380 x1870604319895808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947487.295483:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319895808:0@lo:400:kworker.0 00000100:00100000:0.0:1783947487.296708:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947487.297601:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947487.297813:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319895680:0@lo:400:kworker.0 00000100:00100000:1.0:1783947487.297861:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947487.298034:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319895680 00000100:00100000:0.0:1783947487.298045:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319895680 00000100:00100000:0.0:1783947487.298120:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783947487.298130:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319895680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947487.298337:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319895680:12345-0@lo:400:kworker.0 Request processed in 209us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947487.298356:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783947487.298829:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319895680:0@lo:400:kworker.0 00000100:00080000:0.0:1783947487.302705:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947487.304093:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319895552 00000100:00100000:2.0:1783947487.304112:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319895552 00000100:00100000:2.0:1783947487.304199:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783947487.304211:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319895552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947487.304340:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319895552:12345-0@lo:400:kworker.0 Request processed in 132us (7640us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947487.304348:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1783947487.304438:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b85dac000 x1870604319895552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947487.304457:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319895552:0@lo:400:kworker.0 00000100:00100000:3.0:1783947487.317309:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319895168 00000100:00100000:3.0:1783947487.317343:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319895168 00000100:00100000:3.0:1783947487.317463:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1783947487.317477:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319895168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947487.317608:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319895168:12345-0@lo:400:kworker.0 Request processed in 134us (20010us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947487.317615:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1783947487.317752:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85daea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319895168:0@lo:400:kworker.0 00010000:00010000:1.0:1783947487.550904:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947487.805820:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947487.805868:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319896064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947487.806111:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947487.806198:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319896064 00000100:00100000:3.0:1783947487.806209:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319896064 00000100:00100000:3.0:1783947487.806270:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783947487.806281:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319896064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783947487.806352:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783947487.806410:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319896064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947487.806448:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1783947487.806500:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c85c31500 x1870604319896064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947487.806896:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319896064:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1783947487.890162:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1aaa8892-ac73-492b-a5e2-3055ae3e2dca 00010000:00010000:0.0:1783947488.571057:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947489.594032:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783947489.957909:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1aaa8892-ac73-492b-a5e2-3055ae3e2dca 00000001:00100000:2.0:1783947490.450281:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1aaa8892-ac73-492b-a5e2-3055ae3e2dca 00010000:00010000:0.0:1783947490.625863:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947491.081546:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947491.081612:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947491.081662:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947491.081695:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947491.081736:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947491.081767:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297842816 00000100:00100000:1.0:1783947491.081777:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297842816 00000100:00100000:1.0:1783947491.081861:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297842688 00000100:00100000:1.0:1783947491.081865:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297842688 00000100:00100000:1.0:1783947491.081888:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00100000:1.0:1783947491.081898:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2354:x1870604297842816:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947491.081926:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297843072 00000100:00100000:0.0:1783947491.081930:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297843072 00000100:00100000:0.0:1783947491.081963:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297842944 00000100:00100000:0.0:1783947491.081966:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297842944 00000100:00100000:1.0:1783947491.081983:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2354:x1870604297842816:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 86us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947491.081983:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:0.0:1783947491.081991:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2354:x1870604297843072:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947491.082019:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2354:x1870604297843072:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 29us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947491.082026:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:0.0:1783947491.082044:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:0.0:1783947491.082050:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2354:x1870604297842944:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947491.082071:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2354:x1870604297842944:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 22us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947491.082077:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00080000:0.0:1783947491.082092:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783947491.082097:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783947491.082099:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947491.082111:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00100000:0.0:1783947491.082117:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297842688:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947491.082142:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297842688:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 26us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947491.082148:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00100000:1.0:1783947491.082208:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00100000:3.0:1783947491.082457:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297842560 00000100:00100000:3.0:1783947491.082462:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297842560 00000100:00100000:3.0:1783947491.082490:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 221 00000100:00100000:3.0:1783947491.082496:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:2354:x1870604297842560:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947491.082523:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:2354:x1870604297842560:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 28us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947491.082530:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 221 00010000:00010000:1.0:1783947491.642336:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947492.411718:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947492.411744:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319896192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947492.411828:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947492.411967:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319896192 00000100:00100000:2.0:1783947492.411984:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319896192 00000100:00100000:2.0:1783947492.412045:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783947492.412055:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319896192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947492.412091:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947492.412136:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319896192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947492.412150:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1783947492.412272:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783947492.412301:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd443480 x1870604319896192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947492.412319:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319896192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947492.412693:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319896576:0@lo:400:kworker.0 00000100:00100000:1.0:1783947492.412726:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947492.412754:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947492.412760:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319896704:0@lo:400:kworker.0 00000100:00100000:1.0:1783947492.412781:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947492.412820:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319896576 00000100:00100000:1.0:1783947492.412824:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319896576 00000100:00100000:1.0:1783947492.412857:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319896704 00000100:00100000:1.0:1783947492.412860:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319896704 00000100:00100000:1.0:1783947492.412881:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783947492.412888:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319896576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947492.412924:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319896576:12345-0@lo:400:kworker.0 Request processed in 37us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947492.412930:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783947492.412943:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783947492.412950:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319896704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947492.412985:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319896704:12345-0@lo:400:kworker.0 Request processed in 27us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947492.412992:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1783947492.413012:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947492.413030:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319896704:0@lo:400:kworker.0 00000100:00100000:1.0:1783947492.413039:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319896576:0@lo:400:kworker.0 00000100:00100000:3.0:1783947492.413938:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319896448:0@lo:400:kworker.0 00000100:00100000:3.0:1783947492.414000:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947492.414035:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783947492.414042:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319896320:0@lo:400:kworker.0 00000100:00100000:3.0:1783947492.414069:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947492.414103:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319896832:0@lo:400:kworker.0 00000100:00100000:3.0:1783947492.414136:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947492.414164:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319896832 00000100:00100000:3.0:1783947492.414170:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319896832 00000100:00100000:3.0:1783947492.414213:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783947492.414219:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319896832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947492.414266:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319896832:12345-0@lo:400:kworker.0 Request processed in 47us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947492.414272:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1783947492.414292:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783947492.414313:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b85d63100 x1870604319896832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947492.414326:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319896832:0@lo:400:kworker.0 00000100:00100000:0.0:1783947492.414462:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319896320 00000100:00100000:0.0:1783947492.414466:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319896320 00000100:00100000:0.0:1783947492.414503:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1783947492.414510:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319896320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947492.414545:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319896320:12345-0@lo:400:kworker.0 Request processed in 36us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947492.414560:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1783947492.415078:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319896448 00000100:00100000:1.0:1783947492.415084:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319896448 00000100:00100000:1.0:1783947492.415123:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783947492.415130:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319896448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947492.415171:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319896448:12345-0@lo:400:kworker.0 Request processed in 42us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947492.415177:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783947492.416028:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319896320:0@lo:400:kworker.0 00000100:00100000:3.0:1783947492.416043:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319896448:0@lo:400:kworker.0 00010000:00010000:3.0:1783947492.666010:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947492.922436:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783947492.922459:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319896960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947492.922520:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947492.922667:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319896960 00000100:00100000:3.0:1783947492.922675:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319896960 00000100:00100000:3.0:1783947492.922716:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783947492.922725:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319896960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783947492.922758:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783947492.922811:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319896960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947492.922818:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1783947492.922978:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c85c31f80 x1870604319896960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947492.922996:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319896960:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783947493.689594:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783947493.865395:0:10181:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1783947494.715219:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947495.740870:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947496.227276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947496.227321:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947496.227350:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947496.227371:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947496.227394:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947496.227441:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297843712 00000100:00100000:1.0:1783947496.227451:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297843712 00000100:00100000:1.0:1783947496.227496:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297843584 00000100:00100000:1.0:1783947496.227499:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297843584 00000100:00100000:1.0:1783947496.227518:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:1.0:1783947496.227527:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2355:x1870604297843712:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947496.227590:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2355:x1870604297843712:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 64us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947496.227597:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:1.0:1783947496.227625:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:1.0:1783947496.227632:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2355:x1870604297843584:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947496.227656:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2355:x1870604297843584:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 25us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947496.227689:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:1.0:1783947496.227709:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297843456 00000100:00100000:1.0:1783947496.227713:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297843456 00000100:00100000:1.0:1783947496.227738:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297843328 00000100:00100000:1.0:1783947496.227740:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297843328 00000100:00100000:1.0:1783947496.227757:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 78 00000100:00100000:1.0:1783947496.227764:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2355:x1870604297843456:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947496.227882:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 79 00000100:00100000:2.0:1783947496.227892:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2355:x1870604297843328:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947496.227922:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2355:x1870604297843328:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 33us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947496.227928:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 79 00000100:00100000:1.0:1783947496.227992:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2355:x1870604297843456:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 228us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947496.227999:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 78 00000100:00100000:3.0:1783947496.228601:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297843200 00000100:00100000:3.0:1783947496.228631:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297843200 00000100:00100000:3.0:1783947496.228690:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 223 00000100:00100000:3.0:1783947496.228698:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+13:2355:x1870604297843200:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947496.228742:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+13:2355:x1870604297843200:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 45us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947496.228748:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 223 00000100:00080000:3.0:1783947496.228787:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947496.228792:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783947496.228795:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783947496.761777:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947497.531209:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947497.531234:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319897088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947497.531325:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947497.531403:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319897088 00000100:00100000:2.0:1783947497.531410:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319897088 00000100:00100000:2.0:1783947497.531477:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783947497.531485:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319897088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947497.531522:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947497.531563:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319897088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947497.531571:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1783947497.531591:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783947497.531631:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd443800 x1870604319897088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947497.531662:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319897088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947497.538822:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319897216:0@lo:400:kworker.0 00000100:00100000:1.0:1783947497.538893:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947497.539814:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1870604319897472:0@lo:400:kworker.0 00000100:00100000:0.0:1783947497.539863:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947497.539899:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947497.539915:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319897344:0@lo:400:kworker.0 00000100:00100000:0.0:1783947497.539943:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947497.539977:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319897472 00000100:00100000:0.0:1783947497.539984:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319897472 00000100:00100000:0.0:1783947497.540037:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319897344 00000100:00100000:0.0:1783947497.540040:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319897344 00000100:00100000:0.0:1783947497.540060:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783947497.540069:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870604319897472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947497.540119:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870604319897472:12345-0@lo:400:kworker.0 Request processed in 52us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947497.540125:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783947497.540143:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783947497.540149:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319897344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947497.540173:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319897344:12345-0@lo:400:kworker.0 Request processed in 24us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947497.540178:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1783947497.540215:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947497.540240:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319897344:0@lo:400:kworker.0 00000100:00100000:0.0:1783947497.540250:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1870604319897472:0@lo:400:kworker.0 00000100:00100000:1.0:1783947497.543027:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947497.543047:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319897600:0@lo:400:kworker.0 00000100:00100000:1.0:1783947497.543120:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947497.543179:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319897216 00000100:00100000:1.0:1783947497.543187:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319897216 00000100:00100000:1.0:1783947497.543495:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1783947497.543503:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319897216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947497.543553:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319897216:12345-0@lo:400:kworker.0 Request processed in 50us (4659us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947497.543559:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1783947497.543623:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319897216:0@lo:400:kworker.0 00000100:00100000:1.0:1783947497.543661:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319897600 00000100:00100000:1.0:1783947497.543665:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319897600 00000100:00100000:1.0:1783947497.543711:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783947497.543717:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319897600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947497.543753:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319897600:12345-0@lo:400:kworker.0 Request processed in 36us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947497.545014:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783947497.545069:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319897600:0@lo:400:kworker.0 00000100:00080000:1.0:1783947497.545101:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947497.551223:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947497.551246:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319897728:0@lo:400:kworker.0 00000100:00100000:1.0:1783947497.551312:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947497.551359:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319897728 00000100:00100000:1.0:1783947497.551366:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319897728 00000100:00100000:1.0:1783947497.551440:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783947497.551450:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319897728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947497.551508:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319897728:12345-0@lo:400:kworker.0 Request processed in 60us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947497.551516:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1783947497.551537:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783947497.551567:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cb6587800 x1870604319897728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947497.551581:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319897728:0@lo:400:kworker.0 00010000:00010000:2.0:1783947497.788025:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947498.042404:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947498.042653:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319897856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947498.042738:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947498.042811:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319897856 00000100:00100000:3.0:1783947498.042819:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319897856 00000100:00100000:3.0:1783947498.042880:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783947498.042888:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319897856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783947498.042925:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783947498.042977:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319897856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947498.042985:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1783947498.046339:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c84f53100 x1870604319897856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947498.046368:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319897856:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783947498.810124:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947499.842655:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947500.862871:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947501.320803:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947501.320847:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947501.320884:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947501.320909:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947501.320953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947501.320982:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297844352 00000100:00100000:1.0:1783947501.320992:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297844352 00000100:00100000:1.0:1783947501.321044:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297844224 00000100:00100000:1.0:1783947501.321047:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297844224 00000100:00100000:1.0:1783947501.321071:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:1.0:1783947501.321081:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2356:x1870604297844352:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947501.321156:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2356:x1870604297844352:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 77us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947501.321165:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:1.0:1783947501.321183:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:1.0:1783947501.321191:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2356:x1870604297844224:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947501.321216:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2356:x1870604297844224:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 27us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947501.321222:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00080000:1.0:1783947501.321243:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947501.321247:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947501.321444:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297843840 00000100:00100000:2.0:1783947501.321450:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297843840 00000100:00100000:2.0:1783947501.321485:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 225 00000100:00100000:2.0:1783947501.321492:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:2356:x1870604297843840:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947501.321539:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:2356:x1870604297843840:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 47us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947501.321546:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 225 00000100:00100000:0.0:1783947501.322223:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297844096 00000100:00100000:0.0:1783947501.322240:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297844096 00000100:00100000:0.0:1783947501.322312:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297843968 00000100:00100000:0.0:1783947501.322316:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297843968 00000100:00100000:0.0:1783947501.322341:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 83 00000100:00100000:0.0:1783947501.322359:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2356:x1870604297844096:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947501.322407:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2356:x1870604297844096:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 50us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947501.322414:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 83 00000100:00100000:0.0:1783947501.322462:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00100000:0.0:1783947501.322469:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2356:x1870604297843968:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947501.322493:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2356:x1870604297843968:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 25us (1584us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947501.322499:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00080000:1.0:1783947501.325477:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783947501.885090:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947502.650376:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870604319898240:0@lo:400:kworker.0 00000100:00100000:1.0:1783947502.650479:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947502.650533:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319898752:0@lo:400:kworker.0 00000100:00100000:1.0:1783947502.650557:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947502.650597:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783947502.650603:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319898112:0@lo:400:kworker.0 00000100:00100000:1.0:1783947502.650629:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947502.650649:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319898624:0@lo:400:kworker.0 00000100:00100000:1.0:1783947502.650676:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947502.650705:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319898240 00000100:00100000:1.0:1783947502.650711:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319898240 00000100:00100000:1.0:1783947502.650747:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319898624 00000100:00100000:1.0:1783947502.650750:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319898624 00000100:00100000:1.0:1783947502.650775:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783947502.650783:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870604319898240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947502.650829:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870604319898240:12345-0@lo:400:kworker.0 Request processed in 47us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947502.650836:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783947502.650851:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783947502.650856:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319898624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947502.650878:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319898624:12345-0@lo:400:kworker.0 Request processed in 23us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947502.650883:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783947502.650899:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319898752 00000100:00100000:1.0:1783947502.650902:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319898752 00000100:00100000:1.0:1783947502.650924:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783947502.650929:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319898752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947502.650956:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319898752:12345-0@lo:400:kworker.0 Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947502.650962:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783947502.650977:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319898112 00000100:00100000:1.0:1783947502.650980:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319898112 00000100:00100000:1.0:1783947502.650999:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1783947502.651005:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319898112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947502.651032:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319898112:12345-0@lo:400:kworker.0 Request processed in 28us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947502.651045:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:1.0:1783947502.651075:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947502.651079:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947502.651108:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319898112:0@lo:400:kworker.0 00000100:00100000:1.0:1783947502.651120:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319898624:0@lo:400:kworker.0 00000100:00100000:1.0:1783947502.651128:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870604319898240:0@lo:400:kworker.0 00010000:00080000:1.0:1783947502.651138:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd85d880 x1870604319898752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947502.651148:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319898752:0@lo:400:kworker.0 00000100:00100000:0.0:1783947502.651384:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319898368:0@lo:400:kworker.0 00000100:00100000:0.0:1783947502.651452:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947502.651471:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783947502.651477:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319897984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947502.651501:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947502.651525:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319898496:0@lo:400:kworker.0 00000100:00100000:0.0:1783947502.651543:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947502.651586:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319898496 00000100:00100000:0.0:1783947502.651590:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319898496 00000100:00100000:0.0:1783947502.651621:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783947502.651627:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319898496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947502.651663:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319898496:12345-0@lo:400:kworker.0 Request processed in 36us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947502.651678:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1783947502.651694:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783947502.651712:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd85c000 x1870604319898496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947502.651721:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319898496:0@lo:400:kworker.0 00000100:00100000:2.0:1783947502.651827:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319897984 00000100:00100000:2.0:1783947502.651831:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319897984 00000100:00100000:2.0:1783947502.651868:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783947502.651875:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319897984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947502.651901:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947502.651938:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319897984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947502.651945:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783947502.652067:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319898368 00000100:00100000:1.0:1783947502.652071:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319898368 00000100:00100000:1.0:1783947502.652116:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783947502.652122:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319898368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947502.652154:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319898368:12345-0@lo:400:kworker.0 Request processed in 32us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947502.652161:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1783947502.652214:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783947502.652309:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd443800 x1870604319897984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947502.652324:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319897984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947502.652334:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319898368:0@lo:400:kworker.0 00010000:00010000:1.0:1783947502.906856:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947503.165573:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319898880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947503.165645:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947503.165711:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319898880 00000100:00100000:0.0:1783947503.165718:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319898880 00000100:00100000:0.0:1783947503.165758:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783947503.165767:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319898880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783947503.165799:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947503.165841:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319898880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947503.165848:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1783947503.166014:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c85c30000 x1870604319898880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947503.166032:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319898880:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783947503.929863:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947504.954484:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947505.978286:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947506.438799:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947506.438856:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947506.438895:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947506.439181:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297844608 00000100:00100000:3.0:1783947506.439192:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297844608 00000100:00100000:3.0:1783947506.439259:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297844736 00000100:00100000:3.0:1783947506.439263:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297844736 00000100:00100000:3.0:1783947506.439288:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:3.0:1783947506.439306:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2356:x1870604297844608:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947506.439393:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2356:x1870604297844608:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 89us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947506.439401:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:3.0:1783947506.439440:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 89 00000100:00100000:3.0:1783947506.439448:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2356:x1870604297844736:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947506.439473:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2356:x1870604297844736:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 26us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947506.439479:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 89 00000100:00100000:2.0:1783947506.440738:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297844480 00000100:00100000:2.0:1783947506.440752:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297844480 00000100:00100000:2.0:1783947506.440820:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 227 00000100:00100000:2.0:1783947506.440830:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:2356:x1870604297844480:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947506.440912:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:2356:x1870604297844480:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 83us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947506.440920:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 227 00000100:00080000:2.0:1783947506.440954:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947506.441166:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947506.441293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947506.441531:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297844864 00000100:00100000:1.0:1783947506.441537:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297844864 00000100:00100000:1.0:1783947506.441598:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297844992 00000100:00100000:1.0:1783947506.441602:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297844992 00000100:00100000:1.0:1783947506.441624:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:1.0:1783947506.441632:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cc03cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2352:x1870604297844864:12345-192.168.203.32@tcp:9:kworker.0 00000020:00000080:1.0:1783947506.441668:0:6591:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1dda 00000100:00080000:1.0:1783947506.441677:0:6591:0:(import.c:65:import_set_state_nolock()) ffff8b3cb63ad800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783947506.442760:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:3.0:1783947506.442781:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2352:x1870604297844992:12345-192.168.203.32@tcp:9:kworker.0 00000020:00000080:3.0:1783947506.442806:0:6590:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1de1 00000100:00080000:3.0:1783947506.442815:0:6590:0:(import.c:65:import_set_state_nolock()) ffff8b3cb63ad000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783947506.442853:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1783947506.443184:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+2:2352:x1870604297844992:12345-192.168.203.32@tcp:9:kworker.0 Request processed in 411us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947506.443193:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00080000:3.0:1783947506.443218:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947506.443222:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783947506.443243:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1783947506.443879:0:6591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:0.0:1783947506.444449:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947506.445770:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cc03cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+2:2352:x1870604297844864:12345-192.168.203.32@tcp:9:kworker.0 Request processed in 4130us (4595us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947506.445784:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00010000:00010000:1.0:1783947507.003803:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947507.773143:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319899008:0@lo:400:kworker.0 00000100:00100000:3.0:1783947507.773283:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947507.773346:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319899520:0@lo:400:kworker.0 00000100:00100000:2.0:1783947507.773410:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319899136:0@lo:400:kworker.0 00000100:00100000:3.0:1783947507.773499:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947507.773718:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947507.773739:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319899648:0@lo:400:kworker.0 00000100:00100000:2.0:1783947507.773761:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947507.773782:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947507.773787:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319899264:0@lo:400:kworker.0 00000100:00100000:2.0:1783947507.773805:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947507.773833:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319899520 00000100:00100000:2.0:1783947507.773840:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319899520 00000100:00100000:2.0:1783947507.773886:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319899136 00000100:00100000:2.0:1783947507.773888:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319899136 00000100:00100000:2.0:1783947507.773900:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319899264 00000100:00100000:2.0:1783947507.773902:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319899264 00000100:00100000:2.0:1783947507.773916:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783947507.773924:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319899520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947507.774301:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319899520:12345-0@lo:400:kworker.0 Request processed in 375us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947507.774309:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783947507.774329:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783947507.774336:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319899136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947507.774370:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319899136:12345-0@lo:400:kworker.0 Request processed in 35us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947507.774389:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783947507.774401:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783947507.774407:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319899264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947507.774555:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319899520:0@lo:400:kworker.0 00000100:00100000:3.0:1783947507.774573:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947507.774579:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319899392:0@lo:400:kworker.0 00000100:00100000:3.0:1783947507.774605:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947507.774641:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319899008 00000100:00100000:3.0:1783947507.774646:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319899008 00000100:00100000:3.0:1783947507.774676:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1783947507.774682:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319899008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947507.774714:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319899008:12345-0@lo:400:kworker.0 Request processed in 33us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947507.774719:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1783947507.774752:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319899648 00000100:00100000:3.0:1783947507.774755:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319899648 00000100:00100000:3.0:1783947507.774779:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319899392 00000100:00100000:3.0:1783947507.774782:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319899392 00000100:00100000:3.0:1783947507.774810:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783947507.774817:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319899648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947507.774845:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319899648:12345-0@lo:400:kworker.0 Request processed in 29us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947507.774851:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783947507.774863:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783947507.774869:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319899392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947507.774894:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319899392:12345-0@lo:400:kworker.0 Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947507.774909:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1783947507.774927:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783947507.774932:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947507.774935:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783947507.774963:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c84f53b80 x1870604319899392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947507.774974:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319899392:0@lo:400:kworker.0 00000100:00100000:3.0:1783947507.774983:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319899008:0@lo:400:kworker.0 00000100:00100000:2.0:1783947507.777307:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319899264:12345-0@lo:400:kworker.0 Request processed in 2890us (3491us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947507.777322:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783947507.777386:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319899264:0@lo:400:kworker.0 00000100:00100000:2.0:1783947507.777398:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319899136:0@lo:400:kworker.0 00010000:00080000:2.0:1783947507.777411:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd97ea00 x1870604319899648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947507.777437:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319899648:0@lo:400:kworker.0 00000100:00100000:2.0:1783947507.777512:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947507.777840:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319899776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947507.777879:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947507.777917:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319899776 00000100:00100000:2.0:1783947507.777922:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319899776 00000100:00100000:2.0:1783947507.778257:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783947507.778266:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319899776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947507.778300:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947507.778342:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319899776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947507.778349:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1783947507.778393:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd440000 x1870604319899776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947507.778448:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319899776:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783947508.029266:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947508.284068:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947508.284091:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319899904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947508.284158:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947508.284250:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319899904 00000100:00100000:2.0:1783947508.284258:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319899904 00000100:00100000:2.0:1783947508.284304:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783947508.284315:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319899904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783947508.284346:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947508.284400:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319899904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947508.284407:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1783947508.284516:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd440000 x1870604319899904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947508.284542:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319899904:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1783947508.350558:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1aaa8892-ac73-492b-a5e2-3055ae3e2dca 00000020:00000080:0.0:1783947508.350569:0:6616:0:(genops.c:906:class_export_put()) final put ffff8b3cb63ab000/1aaa8892-ac73-492b-a5e2-3055ae3e2dca 00000020:00000080:0.0:1783947508.350597:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cb63ab000/1aaa8892-ac73-492b-a5e2-3055ae3e2dca for lustre-OST0000 00000020:00000080:0.0:1783947508.350641:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3cb63ad800 for lustre-OST0000 00010000:00010000:3.0:1783947509.051510:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947510.074696:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783947510.905206:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1aaa8892-ac73-492b-a5e2-3055ae3e2dca 00000020:00000080:1.0:1783947510.905219:0:7509:0:(genops.c:906:class_export_put()) final put ffff8b3cb63aa000/1aaa8892-ac73-492b-a5e2-3055ae3e2dca 00000020:00000080:0.0:1783947510.912790:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cb63aa000/1aaa8892-ac73-492b-a5e2-3055ae3e2dca for lustre-OST0001 00000020:00000080:0.0:1783947510.916174:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3cb63ad000 for lustre-OST0001 00010000:00010000:3.0:1783947511.102882:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947511.560356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947511.560402:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947511.560467:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947511.560545:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297845120 00000100:00100000:2.0:1783947511.560545:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297845376 00000100:00100000:3.0:1783947511.560558:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297845120 00000100:00100000:2.0:1783947511.560558:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297845376 00000100:00100000:2.0:1783947511.560618:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297845248 00000100:00100000:2.0:1783947511.560621:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297845248 00000100:00100000:3.0:1783947511.560624:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 229 00000100:00100000:3.0:1783947511.560634:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+13:2356:x1870604297845120:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947511.560642:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:2.0:1783947511.560649:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2356:x1870604297845376:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947511.560742:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2356:x1870604297845376:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 93us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947511.560751:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:2.0:1783947511.560771:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 94 00000100:00100000:2.0:1783947511.560777:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2356:x1870604297845248:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947511.560806:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2356:x1870604297845248:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 29us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947511.560812:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 94 00000100:00100000:3.0:1783947511.560936:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+13:2356:x1870604297845120:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 302us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947511.560943:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 229 00000100:00080000:0.0:1783947511.561772:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783947512.122853:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947512.889732:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319900032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947512.889832:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947512.889933:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319900032 00000100:00100000:1.0:1783947512.889943:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319900032 00000100:00100000:1.0:1783947512.890019:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783947512.890044:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319900032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783947512.890090:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783947512.890165:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319900032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947512.890175:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1783947512.890200:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783947512.890240:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd440000 x1870604319900032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947512.890262:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319900032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947512.894162:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319900416:0@lo:400:kworker.0 00000100:00100000:1.0:1783947512.894269:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947512.894363:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319900416 00000100:00100000:1.0:1783947512.894374:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319900416 00000100:00100000:1.0:1783947512.894493:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783947512.894515:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319900416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947512.894579:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319900416:12345-0@lo:400:kworker.0 Request processed in 68us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947512.894587:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1783947512.894612:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947512.894650:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319900416:0@lo:400:kworker.0 00000100:00100000:1.0:1783947512.894698:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319900544:0@lo:400:kworker.0 00000100:00100000:1.0:1783947512.894728:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947512.894923:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319900160:0@lo:400:kworker.0 00000100:00100000:2.0:1783947512.894988:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947512.895023:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319900672:0@lo:400:kworker.0 00000100:00100000:2.0:1783947512.895051:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947512.895074:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947512.895081:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319900288:0@lo:400:kworker.0 00000100:00100000:2.0:1783947512.895104:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947512.895135:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319900544 00000100:00100000:2.0:1783947512.895139:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319900544 00000100:00100000:2.0:1783947512.895175:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319900288 00000100:00100000:2.0:1783947512.895179:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319900288 00000100:00100000:2.0:1783947512.895195:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783947512.895201:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319900544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947512.895241:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319900544:12345-0@lo:400:kworker.0 Request processed in 40us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947512.895249:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783947512.895264:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783947512.895270:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319900288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947512.895302:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319900288:12345-0@lo:400:kworker.0 Request processed in 33us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947512.895308:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783947512.895331:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319900160 00000100:00100000:2.0:1783947512.895335:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319900160 00000100:00100000:2.0:1783947512.895375:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1783947512.895382:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319900160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947512.895413:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319900160:12345-0@lo:400:kworker.0 Request processed in 31us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947512.895450:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1783947512.895485:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319900672 00000100:00100000:2.0:1783947512.895489:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319900672 00000100:00100000:2.0:1783947512.895534:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783947512.895541:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319900672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947512.895573:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319900672:12345-0@lo:400:kworker.0 Request processed in 32us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947512.895580:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1783947512.895606:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783947512.895611:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947512.895634:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319900288:0@lo:400:kworker.0 00000100:00100000:2.0:1783947512.895643:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319900160:0@lo:400:kworker.0 00010000:00080000:2.0:1783947512.895656:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd85d500 x1870604319900672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947512.895668:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319900672:0@lo:400:kworker.0 00000100:00100000:2.0:1783947512.895704:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319900544:0@lo:400:kworker.0 00010000:00010000:3.0:1783947513.148332:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783947513.382354:0:10884:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1783947513.402660:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319900800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947513.402738:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947513.402967:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319900800 00000100:00100000:2.0:1783947513.402976:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319900800 00000100:00100000:2.0:1783947513.403025:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783947513.403033:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319900800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783947513.403067:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947513.403360:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319900800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 327us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947513.403368:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1783947513.404285:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd443480 x1870604319900800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947513.404306:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319900800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783947514.169719:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947515.199768:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947516.218637:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947516.678129:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947516.679367:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297845504 00000100:00100000:2.0:1783947516.679380:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297845504 00000100:00100000:2.0:1783947516.679457:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 231 00000100:00100000:2.0:1783947516.679467:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:2353:x1870604297845504:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947516.679562:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:2353:x1870604297845504:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 96us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947516.679706:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 231 00000100:00100000:0.0:1783947516.682236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947516.682891:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297845632 00000100:00100000:0.0:1783947516.682969:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297845632 00000100:00100000:0.0:1783947516.683036:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00100000:0.0:1783947516.683049:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2353:x1870604297845632:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947516.683125:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2353:x1870604297845632:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 80us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947516.683133:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00080000:0.0:1783947516.683156:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947516.685839:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947516.686009:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297845760 00000100:00100000:0.0:1783947516.686018:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297845760 00000100:00100000:0.0:1783947516.686136:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 99 00000100:00100000:0.0:1783947516.686147:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2353:x1870604297845760:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947516.686249:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2353:x1870604297845760:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 104us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947516.686257:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 99 00000100:00080000:1.0:1783947516.686673:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1783947517.138885:0:11032:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0342b270 20000000:00000080:3.0:1783947517.138902:0:11032:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b3c8661ec00 uarg=0000000000000000 20000000:01000000:3.0:1783947517.138935:0:11032:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783947517.138940:0:11032:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783947517.138944:0:11032:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783947517.139675:0:11033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1783947517.139917:0:11032:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783947517.146893:0:11032:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783947517.146925:0:11032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b3c8147ca00/0x20c3e53e78bb1de8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.146943:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1d94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d8d expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.146950:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb1da2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1d9b expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.146959:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1da9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf1d expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.146966:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1db7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1db0 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.146973:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3c85670400/0x20c3e53e78bb1dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf55 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.146979:0:11032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b3c8147ca00/0x20c3e53e78bb1de8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.147022:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3c85670400/0x20c3e53e78bb1dcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf55 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.147035:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b3c85670400/0x20c3e53e78bb1dcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf55 expref: 12 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947517.147062:0:11032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1870604319900928:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947517.147200:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1db0 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.147209:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1db7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1db0 expref: 18 pid: 5791 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947517.147218:0:11032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1870604319901056:0@lo:104: 00000100:00100000:3.0:1783947517.147255:0:11032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783947517.147296:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf1d expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.147305:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1da9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf1d expref: 12 pid: 5789 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947517.147313:0:11032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1870604319901184:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947517.147343:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb1da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1d9b expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.147351:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb1da2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1d9b expref: 18 pid: 5790 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947517.147358:0:11032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1870604319901312:0@lo:104: 00000100:00100000:3.0:1783947517.147381:0:11032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783947517.147477:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1d94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1d8d expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.147487:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1d94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1d8d expref: 18 pid: 5791 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947517.147504:0:11032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f53100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1870604319901440:0@lo:104: 00000100:00100000:3.0:1783947517.147703:0:11032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947517.147720:0:11032:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e68780 going to sleep for 11 seconds 00000100:00100000:2.0:1783947517.147902:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319901056 00000100:00100000:2.0:1783947517.147910:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319901056 00000100:00100000:2.0:1783947517.147947:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319901312 00000100:00100000:2.0:1783947517.147951:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319901312 00000100:00100000:2.0:1783947517.147961:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319901440 00000100:00100000:2.0:1783947517.147964:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319901440 00000100:00100000:2.0:1783947517.147977:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783947517.147987:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+5:11032:x1870604319901056:12345-0@lo:104: 00010000:00010000:2.0:1783947517.148000:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b200/0x20c3e53e78bb1db0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1db7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.148062:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783947517.148068:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+5:11032:x1870604319901056:12345-0@lo:104: Request processed in 84us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947517.148075:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783947517.148092:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783947517.148099:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+4:11032:x1870604319901312:12345-0@lo:104: 00010000:00010000:2.0:1783947517.148106:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1d9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1da2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.148153:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783947517.148159:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+4:11032:x1870604319901312:12345-0@lo:104: Request processed in 61us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947517.148165:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783947517.148177:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783947517.148183:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:11032:x1870604319901440:12345-0@lo:104: 00010000:00010000:2.0:1783947517.148190:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b800/0x20c3e53e78bb1d8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1d94 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.148215:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783947517.148219:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:11032:x1870604319901440:12345-0@lo:104: Request processed in 37us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947517.148225:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1783947517.148242:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783947517.148247:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b200/0x20c3e53e78bb1db0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1db7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.148254:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b200 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:2.0:1783947517.148258:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b200/0x20c3e53e78bb1db0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1db7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.148266:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b200/0x20c3e53e78bb1db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1db7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947517.148274:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b200/0x20c3e53e78bb1db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1db7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947517.148280:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783947517.148319:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b200/0x20c3e53e78bb1db0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1db7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.148326:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947517.148347:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b200/0x20c3e53e78bb1db0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1db7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.148355:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b200/0x20c3e53e78bb1db0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1db7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.148368:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947517.148371:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1d9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1da2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.148376:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73ac00 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:2.0:1783947517.148379:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1d9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1da2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.148386:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1d9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1da2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947517.148393:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1d9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1da2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947517.148398:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783947517.148411:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1d9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1da2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.148445:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947517.148452:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1d9b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1da2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.148481:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1d9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1da2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.148491:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947517.148494:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b800/0x20c3e53e78bb1d8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1d94 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.148500:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b800 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:2.0:1783947517.148503:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b800/0x20c3e53e78bb1d8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1d94 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.148510:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b800/0x20c3e53e78bb1d8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1d94 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947517.148516:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b800/0x20c3e53e78bb1d8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1d94 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947517.148521:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783947517.148536:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b800/0x20c3e53e78bb1d8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1d94 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.148542:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947517.148558:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b800/0x20c3e53e78bb1d8d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1d94 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.148566:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b800/0x20c3e53e78bb1d8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1d94 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.148579:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947517.148585:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947517.148587:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947517.148593:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947517.148612:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319901568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947517.148866:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947517.148949:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783947517.148955:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319901696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947517.148979:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947517.149050:0:11032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1870604319901056:0@lo:104: 00000100:00100000:3.0:1783947517.149059:0:11032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1870604319901312:0@lo:104: 00000100:00100000:3.0:1783947517.149066:0:11032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f53100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1870604319901440:0@lo:104: 00000100:00100000:3.0:1783947517.149513:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319901824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947517.150118:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947517.150155:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319901568 00000100:00100000:1.0:1783947517.150163:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319901568 00010000:00010000:1.0:1783947517.150206:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1db7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1db0 expref: 19 pid: 5791 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947517.150239:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319901696 00000100:00100000:1.0:1783947517.150244:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319901696 00010000:00010000:1.0:1783947517.150255:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb1da2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1d9b expref: 20 pid: 5790 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947517.150274:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783947517.150281:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c856ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+20:3311:x1870604319901568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947517.150292:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947517.150297:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1db7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1db0 expref: 20 pid: 5791 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.150305:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1db0 expref: 20 pid: 5791 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.150319:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c8147d600/0x20c3e53e78bb1db7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1db0 expref: 20 pid: 5791 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.150333:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947517.150372:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c856ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3311:x1870604319901568:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947517.150379:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783947517.150438:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783947517.150446:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd440000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:3311:x1870604319901696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947517.150454:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947517.150479:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb1da2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1d9b expref: 18 pid: 5790 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.150497:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb1da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1d9b expref: 18 pid: 5790 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.150506:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb1da2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1d9b expref: 18 pid: 5790 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.150515:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947517.150536:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd440000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:3311:x1870604319901696:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947517.150541:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783947517.150574:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319901696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947517.150582:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319901568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947517.150953:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319901824 00000100:00100000:3.0:1783947517.150958:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319901824 00010000:00010000:3.0:1783947517.150976:0:8318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1d94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1d8d expref: 17 pid: 5791 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947517.151012:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783947517.151020:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:3313:x1870604319901824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947517.151027:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947517.151032:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1d94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1d8d expref: 17 pid: 5791 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.151040:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1d94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1d8d expref: 17 pid: 5791 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.151049:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1d94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1d8d expref: 17 pid: 5791 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.151058:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947517.151128:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:3313:x1870604319901824:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947517.151145:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783947517.151249:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319901824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947517.158646:0:11032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1870604319900928:192.168.203.32@tcp:104: 00000100:00100000:3.0:1783947517.158663:0:11032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1870604319901184:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947517.158695:0:11032:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b3c8147ca00/0x20c3e53e78bb1de8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947517.162515:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947517.162592:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947517.162731:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297845888 00000100:00100000:1.0:1783947517.162739:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297845888 00010000:00010000:1.0:1783947517.162776:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3c85670400/0x20c3e53e78bb1dcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf55 expref: 13 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947517.162813:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297846016 00000100:00100000:1.0:1783947517.162816:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297846016 00010000:00010000:1.0:1783947517.162826:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1da9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf1d expref: 14 pid: 5789 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947517.162849:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:1.0:1783947517.162858:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd443480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d64dfe14-87c9-4273-a23c-517e593e369d+14:2354:x1870604297845888:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947517.162872:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947517.162877:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3c85670400/0x20c3e53e78bb1dcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf55 expref: 14 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.162887:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3c85670400/0x20c3e53e78bb1dcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf55 expref: 14 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.162902:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c85670400/0x20c3e53e78bb1dcc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf55 expref: 14 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.162920:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947517.162963:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd443480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d64dfe14-87c9-4273-a23c-517e593e369d+13:2354:x1870604297845888:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 106us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947517.162969:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:1.0:1783947517.162984:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:1.0:1783947517.163002:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd440a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d64dfe14-87c9-4273-a23c-517e593e369d+12:2354:x1870604297846016:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947517.163008:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947517.163013:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1da9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf1d expref: 12 pid: 5789 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.163022:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf1d expref: 12 pid: 5789 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.163032:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c8147c200/0x20c3e53e78bb1da9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf1d expref: 12 pid: 5789 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.163042:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b3c8147ca00/0x20c3e53e78bb1de8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.163050:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c8147ca00/0x20c3e53e78bb1de8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.163063:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3c8147ca00/0x20c3e53e78bb1de8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.163069:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3c8147ca00/0x20c3e53e78bb1de8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.163075:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b3c8147ca00/0x20c3e53e78bb1de8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.163081:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b3c8147ca00/0x20c3e53e78bb1de8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.163086:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147ca00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947517.163090:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b3c8147ca00/0x20c3e53e78bb1de8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.163104:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b3c8147ca00/0x20c3e53e78bb1de8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.163115:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b3c8147ca00/0x20c3e53e78bb1de8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.163123:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947517.163141:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd440a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d64dfe14-87c9-4273-a23c-517e593e369d+11:2354:x1870604297846016:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 140us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947517.163146:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 29 00010000:00010000:3.0:1783947517.163372:0:11032:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b3c8147ca00/0x20c3e53e78bb1de8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.163381:0:11032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b3c8147ca00/0x20c3e53e78bb1de8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.163386:0:11032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c8147ca00/0x20c3e53e78bb1de8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.248925:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947518.009949:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319901952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947518.010006:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319902208:0@lo:400:kworker.0 00000100:00100000:3.0:1783947518.010029:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947518.010048:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947518.010112:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319902464:0@lo:400:kworker.0 00000100:00100000:3.0:1783947518.010141:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947518.010141:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319902080:0@lo:400:kworker.0 00000100:00100000:3.0:1783947518.010164:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947518.010172:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319902336:0@lo:400:kworker.0 00000100:00100000:0.0:1783947518.010185:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947518.010202:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947518.010217:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319902592:0@lo:400:kworker.0 00000100:00100000:3.0:1783947518.010239:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319902464 00000100:00100000:0.0:1783947518.010246:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947518.010247:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319902464 00000100:00100000:0.0:1783947518.010298:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319902208 00000100:00100000:0.0:1783947518.010303:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319902208 00000100:00100000:3.0:1783947518.010310:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783947518.010322:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319902464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947518.010335:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319902336 00000100:00100000:0.0:1783947518.010339:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319902336 00000100:00100000:0.0:1783947518.010355:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319902592 00000100:00100000:0.0:1783947518.010358:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319902592 00000100:00100000:0.0:1783947518.010374:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783947518.010381:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319902208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947518.012023:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319901952 00000100:00100000:1.0:1783947518.012037:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319901952 00000100:00100000:1.0:1783947518.012093:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783947518.012102:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1870604319901952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783947518.012142:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947518.012236:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319902720:0@lo:400:kworker.0 00000100:00100000:0.0:1783947518.012399:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319902208:12345-0@lo:400:kworker.0 Request processed in 2016us (2349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947518.012408:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783947518.012453:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783947518.012471:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319902336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947518.012513:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319902336:12345-0@lo:400:kworker.0 Request processed in 53us (2313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947518.012520:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783947518.012566:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783947518.012574:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319902592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947518.012618:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319902592:12345-0@lo:400:kworker.0 Request processed in 46us (2373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947518.012624:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783947518.012677:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319902592:0@lo:400:kworker.0 00000100:00080000:0.0:1783947518.012718:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947518.012724:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947518.012742:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319902336:0@lo:400:kworker.0 00000100:00100000:0.0:1783947518.012770:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319902080 00000100:00100000:0.0:1783947518.012774:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319902080 00000100:00100000:0.0:1783947518.012802:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1783947518.012821:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:3311:x1870604319902080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947518.012857:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:3311:x1870604319902080:12345-0@lo:400:kworker.0 Request processed in 37us (2672us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947518.012862:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1783947518.012903:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319902080:0@lo:400:kworker.0 00010000:00080000:0.0:1783947518.016941:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b86506d80 x1870604319902464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947518.016961:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319902464:0@lo:400:kworker.0 00000100:00100000:3.0:1783947518.021563:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1870604319902464:12345-0@lo:400:kworker.0 Request processed in 11235us (11414us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947518.021579:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783947518.022409:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319901952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10302us (12375us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947518.022452:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1783947518.023495:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd85e680 x1870604319901952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947518.023522:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319901952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947518.025059:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947518.025171:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319902208:0@lo:400:kworker.0 00000100:00100000:3.0:1783947518.036754:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319902720 00000100:00100000:3.0:1783947518.036769:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319902720 00000100:00100000:3.0:1783947518.037208:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783947518.037221:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319902720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947518.037342:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319902720:12345-0@lo:400:kworker.0 Request processed in 124us (12287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947518.037358:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1783947518.037439:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783947518.038210:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b86505f80 x1870604319902720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947518.038226:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319902720:0@lo:400:kworker.0 00010000:00010000:2.0:1783947518.267930:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783947518.329858:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783947518.329865:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3c83398800 from 7 10000000:01000000:1.0:1783947518.329870:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947518.329914:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b000/0x20c3e53e78bb1def lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.329937:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b000/0x20c3e53e78bb1def lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.329949:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b000/0x20c3e53e78bb1def lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947518.329972:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319902848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947518.330037:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947518.330085:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c981fba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947518.330354:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319902848 00000100:00100000:2.0:1783947518.330362:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319902848 00000100:00100000:2.0:1783947518.330468:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1783947518.330478:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:5793:x1870604319902848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947518.330491:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947518.330506:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1df6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1def expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.330529:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1df6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1def expref: 17 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.330551:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1df6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1def expref: 17 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.330559:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631a00, rc 0) 00000100:00100000:2.0:1783947518.330603:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319902848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947518.330610:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1783947518.330931:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319902848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947518.330946:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b000/0x20c3e53e78bb1def lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1df6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.330954:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b000/0x20c3e53e78bb1def lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1df6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947518.331017:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319902976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947518.331048:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947518.331077:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c981fba80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947518.331126:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319902976 00000100:00100000:0.0:1783947518.331130:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319902976 00000100:00100000:0.0:1783947518.331164:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1783947518.331172:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319902976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947518.331455:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319902976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947518.331473:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1783947518.331683:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319902976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947518.331715:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319903104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947518.331753:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947518.331771:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c981fba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947518.332124:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319903104 00000100:00100000:2.0:1783947518.332129:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319903104 00000100:00100000:2.0:1783947518.332168:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1783947518.332175:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319903104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947518.332319:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319903104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947518.332325:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1783947518.332578:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319903104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783947518.334499:0:11048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783947518.334691:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783947518.334726:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947518.334736:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b000/0x20c3e53e78bb1def lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1df6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.334748:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b000/0x20c3e53e78bb1def lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1df6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947518.334758:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783947518.334761:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3cb6183000 from 7 10000000:01000000:1.0:1783947518.334764:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947518.334798:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1dfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.334807:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1dfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.334817:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1dfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947518.334840:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319903232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947518.334898:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947518.334942:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c981fba80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947518.336254:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319903232 00000100:00100000:0.0:1783947518.336265:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319903232 00000100:00100000:0.0:1783947518.336320:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1783947518.336330:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319903232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947518.336345:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947518.336360:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c85670c00/0x20c3e53e78bb1e04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1dfd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.336385:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c85670c00/0x20c3e53e78bb1e04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1dfd expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.336396:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c85670c00/0x20c3e53e78bb1e04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1dfd expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.336404:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670c00, rc 0) 00000100:00100000:0.0:1783947518.336489:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319903232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947518.336496:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1783947518.336870:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319903232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947518.336887:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1dfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1e04 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.336896:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1dfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1e04 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947518.336957:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319903360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947518.337015:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947518.337048:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c981fba80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947518.337305:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319903360 00000100:00100000:0.0:1783947518.337310:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319903360 00000100:00100000:0.0:1783947518.337354:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1783947518.337370:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319903360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947518.337658:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319903360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947518.337954:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319903360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947518.337997:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319903488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947518.338039:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947518.338062:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c981fba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947518.338164:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319903488 00000100:00100000:2.0:1783947518.338169:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319903488 00000100:00100000:2.0:1783947518.338206:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1783947518.338214:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319903488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947518.338373:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319903488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947518.338380:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1783947518.338607:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1783947518.338878:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319903488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783947518.341354:0:11049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783947518.341811:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783947518.341837:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783947518.341848:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1dfd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1e04 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.341879:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1dfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1e04 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947518.341890:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783947518.341893:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3c85ce6800 from 7 10000000:01000000:2.0:1783947518.341895:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783947518.341929:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630c00/0x20c3e53e78bb1e0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.341936:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630c00/0x20c3e53e78bb1e0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.341947:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630c00/0x20c3e53e78bb1e0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947518.341982:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86507b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319903616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783947518.342044:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947518.342085:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e2b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947518.342327:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319903616 00000100:00100000:1.0:1783947518.342334:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319903616 00000100:00100000:1.0:1783947518.342387:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1783947518.342397:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319903616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947518.342575:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947518.342590:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cad73ba00/0x20c3e53e78bb1e12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1e0b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.342614:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cad73ba00/0x20c3e53e78bb1e12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1e0b expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.342625:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cad73ba00/0x20c3e53e78bb1e12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1e0b expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.342634:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73ba00, rc 0) 00000100:00100000:1.0:1783947518.342853:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319903616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 456us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947518.342861:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1783947518.343073:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86507b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319903616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947518.343089:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630c00/0x20c3e53e78bb1e0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1e12 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.343098:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630c00/0x20c3e53e78bb1e0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1e12 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947518.343169:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319903744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947518.343202:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947518.343231:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e68e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783947518.344474:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319903744 00000100:00100000:1.0:1783947518.344490:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319903744 00000100:00100000:1.0:1783947518.344534:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1783947518.344543:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319903744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947518.344835:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319903744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947518.344843:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1783947518.344906:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319903744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947518.344949:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319903872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947518.345293:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947518.345329:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c981fb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947518.345529:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319903872 00000100:00100000:0.0:1783947518.345535:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319903872 00000100:00100000:0.0:1783947518.345569:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1783947518.345576:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319903872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947518.345747:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319903872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947518.345754:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1783947518.347681:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319903872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783947518.349235:0:11050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783947518.354788:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783947518.354823:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783947518.354835:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630c00/0x20c3e53e78bb1e0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1e12 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.354848:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630c00/0x20c3e53e78bb1e0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1e12 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947518.524336:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947518.524357:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319904000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947518.524937:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947518.525869:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319904000 00000100:00100000:1.0:1783947518.525879:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319904000 00000100:00100000:1.0:1783947518.525932:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783947518.525942:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319904000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947518.526053:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783947518.526122:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319904000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 182us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947518.526128:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1783947518.526172:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b86504380 x1870604319904000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947518.526190:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319904000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947519.047487:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947519.048081:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297846144 00000100:00100000:0.0:1783947519.048098:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297846144 00000100:00100000:0.0:1783947519.048179:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 242 00000100:00100000:0.0:1783947519.048191:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+11:5573:x1870604297846144:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947519.048215:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947519.048240:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c85670800/0x20c3e53e78bb1e19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aaf7f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.048278:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c85670800/0x20c3e53e78bb1e19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf7f expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.048292:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c85670800/0x20c3e53e78bb1e19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf7f expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.048303:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670800, rc 0) 00000100:00100000:0.0:1783947519.048389:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+12:5573:x1870604297846144:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 201us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947519.048405:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 242 00000100:00100000:0.0:1783947519.057408:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947519.057640:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297846272 00000100:00100000:2.0:1783947519.057654:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297846272 00000100:00100000:2.0:1783947519.057716:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 243 00000100:00100000:2.0:1783947519.057728:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+12:5573:x1870604297846272:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947519.058388:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+12:5573:x1870604297846272:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 658us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947519.058411:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 243 00000100:00100000:2.0:1783947519.067106:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947519.067847:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297846400 00000100:00100000:1.0:1783947519.067874:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297846400 00000100:00100000:1.0:1783947519.067945:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 244 00000100:00100000:1.0:1783947519.067957:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+12:5573:x1870604297846400:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947519.068321:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+12:5573:x1870604297846400:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 364us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947519.068331:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 244 00000100:00100000:1.0:1783947519.074778:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947519.075355:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297846528 00000100:00100000:2.0:1783947519.075369:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297846528 00000100:00100000:2.0:1783947519.075465:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 245 00000100:00100000:2.0:1783947519.075476:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+12:5573:x1870604297846528:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947519.075498:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947519.075586:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cc0630800/0x20c3e53e78bb1e20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aaf86 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.075685:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cc0630800/0x20c3e53e78bb1e20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf86 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.075701:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cc0630800/0x20c3e53e78bb1e20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf86 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.075712:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630800, rc 0) 00000100:00100000:2.0:1783947519.075852:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:5573:x1870604297846528:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 377us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947519.075860:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 245 00000100:00100000:0.0:1783947519.090270:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947519.090352:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297846656 00000100:00100000:3.0:1783947519.090365:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297846656 00000100:00100000:3.0:1783947519.090861:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 246 00000100:00100000:3.0:1783947519.090876:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:5573:x1870604297846656:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947519.091272:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:5573:x1870604297846656:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 398us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947519.091282:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 246 00000100:00100000:2.0:1783947519.104365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947519.104490:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297846784 00000100:00100000:1.0:1783947519.104504:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297846784 00000100:00100000:1.0:1783947519.104571:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 247 00000100:00100000:1.0:1783947519.104583:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:5573:x1870604297846784:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947519.104908:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:5573:x1870604297846784:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 326us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947519.104917:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 247 00010000:00010000:2.0:1783947519.290342:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947520.314744:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947521.337696:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947521.808775:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947521.808815:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947521.808842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947521.808898:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297846912 00000100:00100000:0.0:1783947521.808908:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297846912 00000100:00100000:0.0:1783947521.808967:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 248 00000100:00100000:0.0:1783947521.808977:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+13:2354:x1870604297846912:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947521.809049:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+13:2354:x1870604297846912:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 74us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947521.809057:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 248 00000100:00100000:0.0:1783947521.809094:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297847040 00000100:00100000:0.0:1783947521.809098:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297847040 00000100:00100000:0.0:1783947521.809135:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297847168 00000100:00100000:0.0:1783947521.809138:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297847168 00000100:00100000:0.0:1783947521.809157:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 103 00000100:00100000:0.0:1783947521.809162:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2353:x1870604297847040:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947521.809196:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2353:x1870604297847040:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 33us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947521.809202:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 103 00000100:00100000:0.0:1783947521.809214:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 104 00000100:00100000:0.0:1783947521.809220:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2354:x1870604297847168:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947521.809243:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2354:x1870604297847168:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 24us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947521.809249:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 104 00000100:00080000:0.0:1783947521.809279:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783947522.367065:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783947522.626829:0:11230:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1783947523.129953:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1870604319904384:0@lo:400:kworker.0 00000100:00100000:1.0:1783947523.130061:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947523.130147:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783947523.130155:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319904256:0@lo:400:kworker.0 00000100:00100000:1.0:1783947523.130181:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947523.130198:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319904768:0@lo:400:kworker.0 00000100:00100000:1.0:1783947523.130225:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947523.130397:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319904384 00000100:00100000:0.0:1783947523.130401:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319904256 00000100:00100000:3.0:1783947523.130408:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319904384 00000100:00100000:0.0:1783947523.130408:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319904256 00000100:00100000:2.0:1783947523.130533:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319904128:0@lo:400:kworker.0 00000100:00100000:2.0:1783947523.130591:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947523.130631:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319904640:0@lo:400:kworker.0 00000100:00100000:2.0:1783947523.130658:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947523.130691:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947523.130698:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319904512:0@lo:400:kworker.0 00000100:00100000:2.0:1783947523.130723:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947523.130752:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319904640 00000100:00100000:2.0:1783947523.130757:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319904640 00000100:00100000:1.0:1783947523.132341:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319904896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947523.132473:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947523.132540:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319904896 00000100:00100000:1.0:1783947523.132548:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319904896 00000100:00100000:1.0:1783947523.132641:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783947523.132653:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319904896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783947523.132704:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783947523.132760:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319904896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947523.132769:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1783947523.132822:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd97d180 x1870604319904896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947523.132844:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319904896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947523.132908:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319904768 00000100:00100000:1.0:1783947523.132913:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319904768 00000100:00100000:1.0:1783947523.132947:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319904512 00000100:00100000:1.0:1783947523.132952:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319904512 00000100:00100000:1.0:1783947523.132974:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783947523.132981:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319904768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947523.133022:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319904768:12345-0@lo:400:kworker.0 Request processed in 42us (2797us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947523.133029:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783947523.133041:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783947523.133047:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319904512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947523.133079:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319904512:12345-0@lo:400:kworker.0 Request processed in 34us (2357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947523.133106:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1783947523.133139:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd85c000 x1870604319904768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947523.133151:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319904768:0@lo:400:kworker.0 00000100:00100000:1.0:1783947523.133196:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319904128 00000100:00100000:1.0:1783947523.133200:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319904128 00000100:00100000:1.0:1783947523.133229:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1783947523.133236:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319904128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947523.133271:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319904128:12345-0@lo:400:kworker.0 Request processed in 35us (2680us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947523.133277:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1783947523.136446:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783947523.136486:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870604319904384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947523.136928:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783947523.136942:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319904256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947523.137095:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319904256:12345-0@lo:400:kworker.0 Request processed in 157us (6912us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947523.137104:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783947523.137376:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870604319904384:12345-0@lo:400:kworker.0 Request processed in 915us (7315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947523.137384:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783947523.137511:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319904256:0@lo:400:kworker.0 00000100:00100000:3.0:1783947523.137526:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1870604319904384:0@lo:400:kworker.0 00000100:00080000:0.0:1783947523.137991:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783947523.137999:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783947523.138004:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783947523.138255:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd85d180 x1870604319904512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947523.138271:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319904512:0@lo:400:kworker.0 00000100:00100000:3.0:1783947523.138287:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319904128:0@lo:400:kworker.0 00000100:00100000:2.0:1783947523.142480:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783947523.142515:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319904640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947523.143144:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319904640:12345-0@lo:400:kworker.0 Request processed in 645us (12480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947523.143155:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783947523.143299:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319904640:0@lo:400:kworker.0 00010000:00010000:2.0:1783947523.391838:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947523.642564:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947523.642606:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319905024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947523.642711:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947523.642998:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319905024 00000100:00100000:2.0:1783947523.643008:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319905024 00000100:00100000:2.0:1783947523.643067:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783947523.643077:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319905024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783947523.643123:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947523.643178:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319905024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947523.643186:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1783947523.643293:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b86506a00 x1870604319905024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947523.643314:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319905024:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783947524.412214:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947525.434632:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947526.458607:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947526.921496:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947526.921533:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947526.921660:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297847296 00000100:00100000:1.0:1783947526.921670:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297847296 00000100:00100000:1.0:1783947526.921721:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 250 00000100:00100000:1.0:1783947526.921730:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:2355:x1870604297847296:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947526.921802:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:2355:x1870604297847296:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 73us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947526.921809:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 250 00000100:00100000:0.0:1783947526.921907:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947526.921927:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297847552 00000100:00100000:0.0:1783947526.921931:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297847552 00000100:00100000:0.0:1783947526.921961:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297847424 00000100:00100000:0.0:1783947526.921963:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297847424 00000100:00100000:0.0:1783947526.921981:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 108 00000100:00100000:0.0:1783947526.921987:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2355:x1870604297847552:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947526.922018:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2355:x1870604297847552:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 32us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947526.922024:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 108 00000100:00100000:0.0:1783947526.922107:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 109 00000100:00100000:0.0:1783947526.922117:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2355:x1870604297847424:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947526.922154:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2355:x1870604297847424:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 39us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947526.922161:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 109 00000100:00080000:0.0:1783947526.922181:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1783947527.238120:0:11331:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:58:44 (1783947524) === 00000100:00100000:0.0:1783947527.444653:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947527.444842:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947527.444878:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297847680 00000100:00100000:0.0:1783947527.444888:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297847680 00000100:00100000:0.0:1783947527.444954:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:0.0:1783947527.444964:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2353:x1870604297847680:12345-192.168.203.32@tcp:41:mkdir.0 00000004:00000024:0.0:1783947527.445007:0:6613:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783947527.445089:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2353:x1870604297847680:12345-192.168.203.32@tcp:41:mkdir.0 Request processed in 127us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947527.445097:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:1.0:1783947527.445634:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297847808 00000100:00100000:1.0:1783947527.445641:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297847808 00000100:00100000:1.0:1783947527.445673:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:1.0:1783947527.445681:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:9673:x1870604297847808:12345-192.168.203.32@tcp:700:mkdir.0 00000100:00100000:1.0:1783947527.445724:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:9673:x1870604297847808:12345-192.168.203.32@tcp:700:mkdir.0 Request processed in 45us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947527.445731:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:1.0:1783947527.452014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947527.452050:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297848064 00000100:00100000:1.0:1783947527.452059:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297848064 00000100:00100000:1.0:1783947527.452107:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:1.0:1783947527.452115:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:9673:x1870604297848064:12345-192.168.203.32@tcp:36:mkdir.0 00010000:00010000:1.0:1783947527.452168:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947527.452233:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c80030e00/0x20c3e53e78bb1d08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf08 expref: 6 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.452253:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c8281be00) 00010000:00010000:1.0:1783947527.452275:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947527.452851:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb1e27 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.452866:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb1e27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.452877:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb1e27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.452917:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb1e2e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.452932:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb1e2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.452941:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb1e2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947527.455355:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783947527.455372:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb1e27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.455753:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb1e27 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.455760:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb1e27 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.455767:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73ae00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947527.455771:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb1e27 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.455843:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb1e27 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.455859:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c82977b00) 00010000:00010000:1.0:1783947527.455862:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947527.455866:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb1e27 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.455871:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb1e27 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947527.455892:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000079eadfaf reply state 00000000cc0553c5 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb1e2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947527.455982:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783947527.456076:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:9673:x1870604297848064:12345-192.168.203.32@tcp:36:mkdir.0 Request processed in 3957us (4067us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783947527.456084:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00010000:00010000:2.0:1783947527.457579:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb1e2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.457592:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb1e2e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.457599:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb1e2e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.457617:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947527.457622:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb1e2e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.457628:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb1e2e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.457644:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8b3c82977600) 00010000:00010000:2.0:1783947527.457647:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947527.457652:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb1e2e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.457657:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb1e2e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947527.465725:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947527.465810:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297848192 00000100:00100000:0.0:1783947527.465819:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297848192 00000100:00100000:0.0:1783947527.465880:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:0.0:1783947527.465889:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:9674:x1870604297848192:12345-192.168.203.32@tcp:101:chmod.0 00010000:00010000:0.0:1783947527.465911:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947527.465933:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb1e35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aaf8d expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.465993:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb1e3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.466006:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb1e3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.466031:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb1e3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947527.466088:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1783947527.466091:0:6613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1783947527.466130:0:6613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb1e3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.466154:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb1e35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf8d expref: 8 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.466175:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb1e3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf8d expref: 7 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.466184:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c8281b700) 00010000:00010000:0.0:1783947527.466187:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947527.466190:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670600, rc 0) 00000100:00100000:0.0:1783947527.466350:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:9674:x1870604297848192:12345-192.168.203.32@tcp:101:chmod.0 Request processed in 460us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947527.466357:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:1.0:1783947527.469180:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947527.469274:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297848448 00000100:00100000:2.0:1783947527.469285:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297848448 00000100:00100000:2.0:1783947527.469344:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:2.0:1783947527.469354:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:9674:x1870604297848448:12345-192.168.203.32@tcp:36:chmod.0 00010000:00010000:2.0:1783947527.469412:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947527.469461:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb1e3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf8d expref: 7 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.469479:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c8281b700) 00010000:00010000:2.0:1783947527.469492:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947527.469519:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e43 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.469532:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.469555:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783947527.469871:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000efbe74c0 reply state 00000000b2850249 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947527.469881:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783947527.469895:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1783947527.469981:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:9674:x1870604297848448:12345-192.168.203.32@tcp:36:chmod.0 Request processed in 628us (810us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1783947527.469989:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00010000:00010000:3.0:1783947527.473624:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.473643:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e43 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.473651:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e43 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.473657:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947527.473662:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e43 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.473670:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e43 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.473689:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84bc6a00) 00010000:00010000:3.0:1783947527.473692:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783947527.473710:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e43 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.473717:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e43 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.481999:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947527.518528:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947527.519131:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297848576 00000100:00100000:2.0:1783947527.519147:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297848576 00000100:00100000:2.0:1783947527.519227:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:2.0:1783947527.519239:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:9675:x1870604297848576:12345-192.168.203.32@tcp:101:chown.0 00010000:00010000:2.0:1783947527.519275:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947527.519304:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb1e4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aaf94 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.519885:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb1e51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.519904:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb1e51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.519918:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb1e51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947527.520019:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1783947527.520023:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783947527.520072:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb1e51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.520107:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb1e4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf94 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.520129:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb1e51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf94 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.520139:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84bc6500) 00010000:00010000:2.0:1783947527.520142:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947527.520146:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631e00, rc 0) 00000100:00100000:2.0:1783947527.520327:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:9675:x1870604297848576:12345-192.168.203.32@tcp:101:chown.0 Request processed in 1090us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947527.520336:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:1.0:1783947527.535849:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947527.540169:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297848704 00000100:00100000:2.0:1783947527.540192:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297848704 00000100:00100000:2.0:1783947527.540299:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:2.0:1783947527.540314:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:9675:x1870604297848704:12345-192.168.203.32@tcp:101:chown.0 00010000:00010000:2.0:1783947527.540345:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947527.540390:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb1e58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aaf9b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540525:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb1e5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540580:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb1e5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540593:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb1e5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540612:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540619:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540626:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540763:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb1e6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540772:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb1e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540780:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb1e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947527.540830:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783947527.540835:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783947527.540864:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb1e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540877:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb1e5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540895:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb1e5f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540902:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb1e5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540908:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630e00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947527.540913:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb1e5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540921:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb1e5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540936:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84bc6500) 00010000:00010000:2.0:1783947527.540940:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947527.540946:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb1e5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540953:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb1e5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540968:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540973:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540979:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.540984:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947527.540993:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.541000:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.541009:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8b3c84bc6d00) 00010000:00010000:2.0:1783947527.541011:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947527.541014:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.541020:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1e66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.541059:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb1e58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf9b expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.541074:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb1e6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf9b expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.541081:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:2.0:1783947527.541083:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947527.541085:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630200, rc 0) 00000100:00100000:2.0:1783947527.541190:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:9675:x1870604297848704:12345-192.168.203.32@tcp:101:chown.0 Request processed in 879us (5356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947527.541200:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:0.0:1783947527.558186:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947527.558321:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297848960 00000100:00100000:2.0:1783947527.558335:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297848960 00000100:00100000:2.0:1783947527.558471:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:2.0:1783947527.558486:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:9675:x1870604297848960:12345-192.168.203.32@tcp:36:chown.0 00010000:00010000:2.0:1783947527.558598:0:6613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947527.558637:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb1e6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf9b expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.558664:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:2.0:1783947527.558679:0:6613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947527.558729:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb1e74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.558746:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb1e74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.558759:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb1e74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783947527.608922:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1783947527.608948:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1783947527.609025:0:6613:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000540b47a4 reply state 000000008e64457e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb1e74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947527.609043:0:6613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783947527.609268:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1783947527.609543:0:6613:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1783947527.609654:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:9675:x1870604297848960:12345-192.168.203.32@tcp:36:chown.0 Request processed in 51164us (51475us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783947527.609666:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00010000:00010000:3.0:1783947527.609830:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb1e74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.609843:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb1e74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.609853:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb1e74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.609861:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947527.609867:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb1e74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.609878:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb1e74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.609898:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:3.0:1783947527.609902:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783947527.609908:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb1e74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.609916:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb1e74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947527.637845:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947527.637970:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297849088 00000100:00100000:2.0:1783947527.637984:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297849088 00000100:00100000:2.0:1783947527.638066:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:2.0:1783947527.638077:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:9676:x1870604297849088:12345-192.168.203.32@tcp:101:touch.500 00010000:00010000:2.0:1783947527.638112:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947527.638156:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb1e7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aafa2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783947527.639394:0:5798:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1169us 00010000:00010000:3.0:1783947527.659462:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1e82 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.659500:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1e82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.659514:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1e82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.659532:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1e89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.659538:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1e89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.659544:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1e89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.662185:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ce00/0x20c3e53e78bb1e90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.662213:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ce00/0x20c3e53e78bb1e90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.662226:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ce00/0x20c3e53e78bb1e90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947527.662325:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783947527.662330:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947527.662471:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ce00/0x20c3e53e78bb1e90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.662489:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1e82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.662506:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1e82 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.662513:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1e82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.662520:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147ca00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947527.662525:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1e82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.662534:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1e82 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.662562:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84bc6500) 00010000:00010000:3.0:1783947527.662566:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947527.662572:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1e82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.662578:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1e82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.662591:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1e89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.662597:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1e89 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.662603:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1e89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.662608:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147d000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947527.662617:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1e89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.662624:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1e89 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.662633:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8b3c84af9800) 00010000:00010000:3.0:1783947527.662636:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947527.662638:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1e89 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.662644:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1e89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.662697:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb1e7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafa2 expref: 8 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.663935:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ce00/0x20c3e53e78bb1e90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafa2 expref: 7 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.663946:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b3c84af9000) 00010000:00010000:3.0:1783947527.663949:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783947527.663952:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147ce00, rc 0) 00000100:00100000:3.0:1783947527.664064:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:9676:x1870604297849088:12345-192.168.203.32@tcp:101:touch.500 Request processed in 25987us (26233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947527.664074:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:1.0:1783947527.671549:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947527.672458:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297849344 00000100:00100000:0.0:1783947527.672474:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297849344 00000100:00100000:0.0:1783947527.672562:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:0.0:1783947527.672574:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:9676:x1870604297849344:12345-192.168.203.32@tcp:101:touch.500 00010000:00010000:0.0:1783947527.672602:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947527.672649:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb1e97 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aafa9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.673061:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1e9e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.673081:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1e9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.673094:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1e9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.673623:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1ea5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.673635:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.673645:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783947527.674727:0:5797:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1783947527.675071:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb1eac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.675088:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb1eac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.675101:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb1eac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.675161:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1e9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.675170:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1e9e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.675176:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1e9e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.675183:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670e00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947527.675188:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1e9e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.675197:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1e9e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.675213:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b3c84af9000) 00010000:00010000:1.0:1783947527.675216:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947527.675221:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1e9e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.675229:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1e9e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947527.675247:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000e01e868 reply state 0000000022262dcb transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947527.675258:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783947527.675303:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb1e97 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafa9 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.675334:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb1eac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafa9 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.675341:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b3c82977800) 00010000:00010000:1.0:1783947527.675344:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947527.675346:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a800, rc 0) 00000100:00100000:1.0:1783947527.675507:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+10:9676:x1870604297849344:12345-192.168.203.32@tcp:101:touch.500 Request processed in 2934us (3972us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783947527.675518:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 22 00010000:00010000:3.0:1783947527.677091:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.677109:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1ea5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.677129:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1ea5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.677136:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73bc00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947527.677141:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1ea5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.677149:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1ea5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.677165:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff8b3c82977b00) 00010000:00010000:3.0:1783947527.677168:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947527.677172:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1ea5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.677179:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1ea5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947527.684727:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947527.684980:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297849600 00000100:00100000:2.0:1783947527.684994:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297849600 00000100:00100000:2.0:1783947527.685065:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:2.0:1783947527.685077:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:9676:x1870604297849600:12345-192.168.203.32@tcp:36:touch.500 00010000:00010000:2.0:1783947527.685157:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947527.685191:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb1eac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafa9 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.685214:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b3c82977800) 00010000:00010000:2.0:1783947527.685230:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947527.685293:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1eba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.685310:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1eba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.685320:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1eba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783947527.685539:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d1ebc67f reply state 00000000d836dbd1 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1eba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947527.685564:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783947527.685690:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+10:9676:x1870604297849600:12345-192.168.203.32@tcp:36:touch.500 Request processed in 614us (977us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783947527.685709:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 23 00010000:00010000:3.0:1783947527.701415:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1eba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.701481:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1eba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.701491:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1eba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.701500:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947527.701506:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1eba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.701543:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1eba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.701578:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b3c84bc6d00) 00010000:00010000:3.0:1783947527.701582:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947527.701588:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1eba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.701595:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1eba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947527.702312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947527.702459:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297849728 00000100:00100000:2.0:1783947527.702484:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297849728 00000100:00100000:2.0:1783947527.702561:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:2.0:1783947527.702574:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:9676:x1870604297849728:12345-192.168.203.32@tcp:101:touch.500 00010000:00010000:2.0:1783947527.702610:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947527.702637:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb1ec1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aafb0 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.702731:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb1ec1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafb0 expref: 10 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.702748:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb1ec1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafb0 expref: 10 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.702771:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:2.0:1783947527.702774:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947527.702777:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630e00, rc 0) 00000100:00100000:2.0:1783947527.702855:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+10:9676:x1870604297849728:12345-192.168.203.32@tcp:101:touch.500 Request processed in 283us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947527.702863:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:2.0:1783947527.706205:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947527.707296:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297849856 00000100:00100000:1.0:1783947527.707317:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297849856 00000100:00100000:1.0:1783947527.707406:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:1.0:1783947527.707454:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1870604297849856:12345-192.168.203.32@tcp:8:touch.500 00010000:00080000:1.0:1783947527.707503:0:6591:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp t0 exp 0000000000000000 cur 342 last 0 00000020:00000080:1.0:1783947527.707545:0:6591:0:(genops.c:1406:class_connect()) connect: client d1ed966c-3190-4795-821d-ae5dca7b5f51, cookie 0x20c3e53e78bb1ec8 00002000:00100000:1.0:1783947527.707560:0:6591:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d1ed966c-3190-4795-821d-ae5dca7b5f51/ffff8b3b85d9b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783947527.707602:0:6591:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783947527.707967:0:6591:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783947527.708014:0:6591:0:(import.c:65:import_set_state_nolock()) ffff8b3ca0bdb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947527.708115:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2352:x1870604297849856:12345-192.168.203.32@tcp:8:touch.500 Request processed in 696us (1926us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947527.708126:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:0.0:1783947527.715295:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947527.719389:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297849984 00000100:00100000:3.0:1783947527.719470:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297849984 00000100:00100000:3.0:1783947527.719595:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:3.0:1783947527.719609:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:0:x1870604297849984:12345-192.168.203.32@tcp:2:touch.500 00000100:00080000:0.0:1783947527.720391:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1783947527.768547:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d1ed966c-3190-4795-821d-ae5dca7b5f51 00000001:00080000:1.0:1783947527.768584:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1783947527.768862:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:0:x1870604297849984:12345-192.168.203.32@tcp:2:touch.500 Request processed in 49249us (53573us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783947527.768876:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:1.0:1783947527.771600:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947527.771706:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297850240 00000100:00100000:0.0:1783947527.771719:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297850240 00000100:00100000:0.0:1783947527.771799:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:0.0:1783947527.771812:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+10:9676:x1870604297850240:12345-192.168.203.32@tcp:35:touch.500 00000100:00100000:0.0:1783947527.772260:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+11:9676:x1870604297850240:12345-192.168.203.32@tcp:35:touch.500 Request processed in 450us (674us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1783947527.772269:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:1.0:1783947527.784330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947527.784456:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297850368 00000100:00100000:2.0:1783947527.784470:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297850368 00000100:00100000:2.0:1783947527.784538:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:2.0:1783947527.784550:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+11:9677:x1870604297850368:12345-192.168.203.32@tcp:101:rm.0 00010000:00010000:2.0:1783947527.784588:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947527.784614:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb1ecf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aafb7 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.784734:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631200/0x20c3e53e78bb1ed6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.784751:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631200/0x20c3e53e78bb1ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.784766:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631200/0x20c3e53e78bb1ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947527.784851:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783947527.784855:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783947527.784899:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631200/0x20c3e53e78bb1ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.784929:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb1ecf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafb7 expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.784950:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631200/0x20c3e53e78bb1ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafb7 expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.784960:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b3c84af9000) 00010000:00010000:2.0:1783947527.784963:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947527.784967:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631200, rc 0) 00000100:00100000:2.0:1783947527.785040:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+12:9677:x1870604297850368:12345-192.168.203.32@tcp:101:rm.0 Request processed in 493us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947527.785048:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:2.0:1783947527.788050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947527.788331:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297850624 00000100:00100000:0.0:1783947527.788346:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297850624 00000100:00100000:0.0:1783947527.788506:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:0.0:1783947527.788519:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+12:9677:x1870604297850624:12345-192.168.203.32@tcp:101:rm.0 00010000:00010000:0.0:1783947527.788572:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947527.788600:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb1edd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aafbe expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947527.788756:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1783947527.788975:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb1edd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafbe expref: 14 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.788991:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84bc6500) 00010000:00010000:0.0:1783947527.788994:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783947527.789000:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb1edd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafbe expref: 14 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.789018:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671800, rc 0) 00000100:00100000:0.0:1783947527.789097:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:9677:x1870604297850624:12345-192.168.203.32@tcp:101:rm.0 Request processed in 581us (1062us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1783947527.789105:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:3.0:1783947527.793073:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947527.794065:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297850752 00000100:00100000:2.0:1783947527.794101:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297850752 00000100:00100000:2.0:1783947527.794168:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:2.0:1783947527.794179:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:9677:x1870604297850752:12345-192.168.203.32@tcp:37:rm.0 00000100:00100000:2.0:1783947527.800726:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:9677:x1870604297850752:12345-192.168.203.32@tcp:37:rm.0 Request processed in 6521us (7640us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947527.800747:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:0.0:1783947527.804336:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947527.804462:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297851008 00000100:00100000:1.0:1783947527.804493:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297851008 00000100:00100000:1.0:1783947527.804578:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1783947527.804590:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85b99450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:9677:x1870604297851008:12345-192.168.203.32@tcp:35:rm.0 00000100:00100000:1.0:1783947527.805274:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85b99450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:9677:x1870604297851008:12345-192.168.203.32@tcp:35:rm.0 Request processed in 681us (949us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1783947527.805285:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:0.0:1783947527.810284:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947527.811099:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297851264 00000100:00100000:1.0:1783947527.811114:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297851264 00000100:00100000:1.0:1783947527.811239:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:1.0:1783947527.811253:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:9677:x1870604297851264:12345-192.168.203.32@tcp:101:rm.0 00010000:00010000:1.0:1783947527.811287:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947527.811317:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b800/0x20c3e53e78bb1eeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aafc5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.811525:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ac00/0x20c3e53e78bb1ef2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.811542:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ac00/0x20c3e53e78bb1ef2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.811567:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ac00/0x20c3e53e78bb1ef2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947527.811581:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1783947527.811758:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b800/0x20c3e53e78bb1eeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafc5 expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.811782:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ac00/0x20c3e53e78bb1ef2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafc5 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947527.811815:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b3c84af9000) 00010000:00010000:1.0:1783947527.811819:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783947527.811824:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73ac00, rc 0) 00000100:00100000:1.0:1783947527.811906:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+16:9677:x1870604297851264:12345-192.168.203.32@tcp:101:rm.0 Request processed in 656us (1637us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1783947527.811915:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:2.0:1783947527.814495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947527.814645:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297851392 00000100:00100000:3.0:1783947527.814658:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297851392 00000100:00100000:3.0:1783947527.814777:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:3.0:1783947527.814789:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+16:9677:x1870604297851392:12345-192.168.203.32@tcp:41:rm.0 00000004:00000024:3.0:1783947527.814870:0:5797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1783947527.814965:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+16:9677:x1870604297851392:12345-192.168.203.32@tcp:41:rm.0 Request processed in 178us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947527.814972:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:0.0:1783947527.817451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947527.817641:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297851520 00000100:00100000:3.0:1783947527.817655:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297851520 00000100:00100000:3.0:1783947527.817800:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:3.0:1783947527.817814:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+16:9677:x1870604297851520:12345-192.168.203.32@tcp:101:rm.0 00010000:00010000:3.0:1783947527.817846:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947527.817875:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1f00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aafcc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.817964:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.817982:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.817996:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818014:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818021:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818028:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818179:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb1f15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818188:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb1f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818218:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb1f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947527.818251:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783947527.818255:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947527.818278:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb1f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818291:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb1f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818300:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818308:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818315:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818321:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147ca00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947527.818325:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818334:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818347:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b3c84af9000) 00010000:00010000:3.0:1783947527.818350:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947527.818355:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818372:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818389:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818411:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818448:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818455:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147c200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947527.818458:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818465:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818473:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff8b3c84af9700) 00010000:00010000:3.0:1783947527.818476:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947527.818479:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818485:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818520:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1f00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafcc expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818535:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb1f15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafcc expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.818548:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:3.0:1783947527.818830:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947527.818834:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147d600, rc 0) 00000100:00100000:2.0:1783947527.819025:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+17:9677:x1870604297851520:12345-192.168.203.32@tcp:101:rm.0 Request processed in 1211us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947527.819036:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:2.0:1783947527.822746:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947527.822844:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297851776 00000100:00100000:0.0:1783947527.822857:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297851776 00000100:00100000:0.0:1783947527.822930:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:0.0:1783947527.822943:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+17:9677:x1870604297851776:12345-192.168.203.32@tcp:36:rm.0 00010000:00010000:0.0:1783947527.823015:0:6613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783947527.823049:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb1f15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafcc expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.823090:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb1ec1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafb0 expref: 16 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.823101:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:0.0:1783947527.823119:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631200/0x20c3e53e78bb1ed6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafb7 expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.823127:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b3c84af9000) 00010000:00010000:0.0:1783947527.823131:0:6613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783947527.823158:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb1f1c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.823172:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb1f1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.823182:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb1f1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.823197:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb1f23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.823205:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb1f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.823211:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb1f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.823365:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1f2a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.823384:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1f2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.823391:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1f2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783947527.824333:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1783947527.824346:0:6613:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343094926891ns, next at 344094924401ns, rc = 0 00010000:00010000:0.0:1783947527.824478:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb1f31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.824492:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb1f31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.824502:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb1f31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.824512:0:6613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb1f31 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.824519:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb1f31 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.824526:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb1f31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.824550:0:6613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947527.824576:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1f2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.824582:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1f2a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.824600:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1f2a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.824607:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670e00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947527.824612:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1f2a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.824619:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1f2a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.824630:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:0.0:1783947527.824633:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783947527.824638:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1f2a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.824645:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb1f2a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.824667:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb1f1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.824674:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb1f1c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.824680:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb1f1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.824685:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947527.824688:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb1f1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.824703:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb1f1c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.824711:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b3c84af9000) 00010000:00010000:0.0:1783947527.824714:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947527.824717:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb1f1c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947527.824723:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb1f1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947527.824735:0:6613:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000efa79885 reply state 00000000ad47a2c9 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb1f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947527.824746:0:6613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783947527.825028:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947527.825038:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb1f31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.825045:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671e00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947527.825048:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb1f31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.825054:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb1f31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.825064:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:3.0:1783947527.825067:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783947527.825070:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb1f31 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.825075:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb1f31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.825094:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947527.825096:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947527.825097:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947527.825503:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+16:9677:x1870604297851776:12345-192.168.203.32@tcp:36:rm.0 Request processed in 2554us (2762us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783947527.825514:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 30 00010000:00010000:3.0:1783947527.827690:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb1f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.827720:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb1f23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.827753:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb1f23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.827760:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947527.827766:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb1f23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.827775:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb1f23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.827793:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff8b3c8281b200) 00010000:00010000:3.0:1783947527.827797:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947527.827803:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb1f23 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.827810:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb1f23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947527.830537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947527.830914:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297852032 00000100:00100000:3.0:1783947527.830928:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297852032 00000100:00100000:3.0:1783947527.830995:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:3.0:1783947527.831006:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+15:9677:x1870604297852032:12345-192.168.203.32@tcp:35:rm.0 00000100:00100000:3.0:1783947527.831343:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+16:9677:x1870604297852032:12345-192.168.203.32@tcp:35:rm.0 Request processed in 337us (821us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1783947527.831351:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:1.0:1783947527.834275:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947527.834378:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297852288 00000100:00100000:3.0:1783947527.834390:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297852288 00000100:00100000:3.0:1783947527.834515:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:3.0:1783947527.834526:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+16:9677:x1870604297852288:12345-192.168.203.32@tcp:36:rm.0 00010000:00010000:3.0:1783947527.834766:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783947527.834818:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ac00/0x20c3e53e78bb1ef2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafc5 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.834848:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ce00/0x20c3e53e78bb1e90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafa2 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.834864:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b3c84af9000) 00010000:00010000:3.0:1783947527.834886:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb1e51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf94 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.834896:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84bc6500) 00010000:00010000:3.0:1783947527.834904:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947527.834936:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1f38 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.834951:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1f38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.834963:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1f38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.834977:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f3f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.834984:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.834992:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.835384:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f46 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.835408:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947527.835415:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947527.837369:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1783947527.837414:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.837503:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f46 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.837512:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f46 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.837519:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147ca00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947527.837524:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f46 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.837533:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f46 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.837616:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b3c84af9e00) 00010000:00010000:2.0:1783947527.837628:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783947527.837634:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f46 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.837641:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1f46 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.837675:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1f38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.837681:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1f38 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.837687:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1f38 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.837692:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147d000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947527.837695:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1f38 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.837771:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1f38 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.837781:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84af9700) 00010000:00010000:2.0:1783947527.837784:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947527.837787:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1f38 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.838024:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1f38 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783947527.838043:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ff21f868 reply state 00000000cb81b95c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947527.838067:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783947527.838268:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+15:9677:x1870604297852288:12345-192.168.203.32@tcp:36:rm.0 Request processed in 3738us (4002us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783947527.838279:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 31 00010000:00010000:2.0:1783947527.847890:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.847914:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f3f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.847924:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f3f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.847932:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147c200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947527.847938:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f3f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.847948:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f3f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.847970:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8b3c84af9800) 00010000:00010000:2.0:1783947527.847973:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947527.847979:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f3f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947527.847985:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147c200/0x20c3e53e78bb1f3f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947528.256949:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947528.256993:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319905152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947528.257120:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947528.257294:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319905152 00000100:00100000:1.0:1783947528.257306:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319905152 00000100:00100000:1.0:1783947528.257458:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783947528.257471:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319905152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783947528.257525:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1783947528.257715:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947528.260588:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319905280:0@lo:400:kworker.0 00000100:00100000:1.0:1783947528.263406:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319905152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5911us (6259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947528.263445:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783947528.263568:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319905408:0@lo:400:kworker.0 00000100:00100000:1.0:1783947528.263622:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947528.263900:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319905664:0@lo:400:kworker.0 00000100:00100000:1.0:1783947528.263932:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947528.263960:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947528.263968:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319905536:0@lo:400:kworker.0 00000100:00100000:1.0:1783947528.263992:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947528.264041:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319905408 00000100:00100000:1.0:1783947528.264050:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319905408 00000100:00100000:1.0:1783947528.264093:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319905664 00000100:00100000:1.0:1783947528.264112:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319905664 00000100:00100000:1.0:1783947528.264138:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319905536 00000100:00100000:1.0:1783947528.264140:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319905536 00000100:00100000:1.0:1783947528.264222:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783947528.264234:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319905408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947528.264298:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319905408:12345-0@lo:400:kworker.0 Request processed in 67us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947528.264306:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783947528.264321:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783947528.264329:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319905664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947528.264364:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319905664:12345-0@lo:400:kworker.0 Request processed in 36us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947528.264370:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783947528.264382:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783947528.264388:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319905536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947528.264465:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319905536:12345-0@lo:400:kworker.0 Request processed in 77us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947528.264471:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783947528.264517:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319905408:0@lo:400:kworker.0 00000100:00100000:0.0:1783947528.264706:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319905536:0@lo:400:kworker.0 00000100:00100000:0.0:1783947528.264719:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319905664:0@lo:400:kworker.0 00000100:00080000:1.0:1783947528.265672:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783947528.265898:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c83377800 x1870604319905152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947528.265925:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319905152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947528.266511:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947528.266638:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319905792:0@lo:400:kworker.0 00000100:00100000:3.0:1783947528.266694:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947528.268734:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319905792 00000100:00100000:1.0:1783947528.268753:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319905792 00000100:00100000:1.0:1783947528.268875:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783947528.268887:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319905792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947528.269006:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319905792:12345-0@lo:400:kworker.0 Request processed in 122us (2311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947528.269033:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1783947528.269357:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783947528.269460:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c812a8380 x1870604319905792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947528.269480:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319905792:0@lo:400:kworker.0 00000100:00100000:0.0:1783947528.270443:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319905280 00000100:00100000:0.0:1783947528.270457:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319905280 00000100:00100000:0.0:1783947528.270529:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1783947528.270539:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3311:x1870604319905280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947528.270812:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3311:x1870604319905280:12345-0@lo:400:kworker.0 Request processed in 274us (4303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947528.270820:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1783947528.271214:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319905280:0@lo:400:kworker.0 00010000:00010000:2.0:1783947528.506638:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947528.763027:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947528.763061:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319905920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947528.763887:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947528.763980:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319905920 00000100:00100000:3.0:1783947528.764005:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319905920 00000100:00100000:3.0:1783947528.764068:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783947528.764078:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85daf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319905920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783947528.764145:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783947528.764944:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85daf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319905920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 863us (1784us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947528.764956:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1783947528.765077:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c83377800 x1870604319905920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947528.765102:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319905920:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783947529.532354:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947530.558923:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947531.578234:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947532.037928:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947532.037978:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947532.038025:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947532.038070:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947532.038083:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297852672 00000100:00100000:1.0:1783947532.038093:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297852544 00000100:00100000:0.0:1783947532.038093:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297852416 00000100:00100000:3.0:1783947532.038100:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297852672 00000100:00100000:1.0:1783947532.038100:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297852544 00000100:00100000:0.0:1783947532.038101:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297852416 00000100:00100000:1.0:1783947532.038161:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297852800 00000100:00100000:1.0:1783947532.038165:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297852800 00000100:00100000:0.0:1783947532.038168:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 252 00000100:00100000:0.0:1783947532.038178:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:2356:x1870604297852416:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947532.038283:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:2356:x1870604297852416:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 106us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947532.038291:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 252 00000100:00100000:3.0:1783947532.040668:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:3.0:1783947532.040754:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2356:x1870604297852672:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947532.040984:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2356:x1870604297852672:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 238us (2957us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947532.040994:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:1.0:1783947532.044088:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00100000:1.0:1783947532.044108:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:2356:x1870604297852544:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947532.044220:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:2356:x1870604297852544:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 118us (6241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947532.044229:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00100000:1.0:1783947532.044251:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 114 00000100:00100000:1.0:1783947532.044260:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2356:x1870604297852800:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947532.044286:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2356:x1870604297852800:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 28us (6216us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947532.044293:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 114 00000100:00080000:1.0:1783947532.044323:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947532.044330:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1783947532.241270:0:11481:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1783947532.613897:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783947532.960001:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:3.0:1783947532.960014:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1783947532.960165:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85daea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319906048:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783947532.960232:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947532.960300:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319906048 00000100:00100000:3.0:1783947532.960308:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319906048 00000100:00100000:3.0:1783947532.960356:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783947532.960377:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319906048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783947532.960402:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1783947532.960454:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a54e106, atime: 0x6a54e106, ctime: 0x6a54e106, blocks: 0x1 00010000:00010000:3.0:1783947532.960461:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb1f4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947532.960491:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=348s v=(0 0) 00010000:00010000:3.0:1783947532.960495:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947532.960502:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb1f4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947532.961638:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb1f4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947532.961657:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb1f4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947532.961666:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb1f4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947532.961686:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783947532.962236:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1870604319906048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1858us (2001us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783947532.962246:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1783947532.962283:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783947532.962313:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947532.962320:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb1f4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947532.962327:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147ce00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947532.962332:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb1f4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947532.962354:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb1f4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947532.962385:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb1f4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947532.962393:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb1f4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947532.962415:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947532.962436:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947532.962439:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783947532.962476:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b3b85daea00/2, rc 0, transno 4294967300 00000100:00100000:3.0:1783947532.962482:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85daea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319906048:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1783947532.963151:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000020:00000080:0.0:1783947533.367867:0:11533:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5d110c00 20000000:00000080:0.0:1783947533.367885:0:11533:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b3cb65acc00 uarg=0000000000000000 20000000:01000000:0.0:1783947533.368926:0:11533:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1783947533.368934:0:11533:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1783947533.368939:0:11533:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000100:00100000:2.0:1783947533.370164:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319906176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947533.370234:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947533.370476:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319906176 00000100:00100000:0.0:1783947533.370485:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319906176 00000100:00100000:0.0:1783947533.370552:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783947533.370562:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319906176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947533.370607:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947533.370653:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319906176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947533.370670:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1783947533.371170:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c83370380 x1870604319906176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947533.371191:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319906176:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1783947533.371569:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1783947533.371869:0:11533:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000100:00080000:2.0:1783947533.373292:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947533.376454:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319906304:0@lo:400:kworker.0 00000100:00100000:0.0:1783947533.376540:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947533.376621:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319906304 00000100:00100000:2.0:1783947533.376630:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319906304 00000100:00100000:2.0:1783947533.376680:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1783947533.376689:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3311:x1870604319906304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947533.381673:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3311:x1870604319906304:12345-0@lo:400:kworker.0 Request processed in 4978us (5126us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947533.381689:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1783947533.381958:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319906304:0@lo:400:kworker.0 00000100:00100000:0.0:1783947533.381983:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947533.382009:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319906432:0@lo:400:kworker.0 00000100:00100000:0.0:1783947533.382072:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1783947533.382758:0:11533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1783947533.382808:0:11533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1783947533.382861:0:11533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1783947533.382879:0:11533:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783947533.382896:0:11533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b3c85670a00/0x20c3e53e78bb1f54 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947533.382914:0:11533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1df6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1def expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947533.382922:0:11533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3c85670c00/0x20c3e53e78bb1e04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1dfd expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947533.382930:0:11533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3cad73ba00/0x20c3e53e78bb1e12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1e0b expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947533.382940:0:11533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3c85670800/0x20c3e53e78bb1e19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf7f expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947533.382949:0:11533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3cc0630800/0x20c3e53e78bb1e20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf86 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947533.382957:0:11533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b3c85670a00/0x20c3e53e78bb1f54 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947533.382989:0:11533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3cc0630800/0x20c3e53e78bb1e20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf86 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947533.383003:0:11533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b3cc0630800/0x20c3e53e78bb1e20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf86 expref: 12 pid: 5789 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947533.383025:0:11533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870604319906560:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947533.383371:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319906432 00000100:00100000:1.0:1783947533.383380:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319906432 00000100:00100000:1.0:1783947533.383448:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783947533.383457:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319906432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947533.383603:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319906432:12345-0@lo:400:kworker.0 Request processed in 146us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947533.383611:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783947533.383655:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319906432:0@lo:400:kworker.0 00010000:00010000:0.0:1783947533.383860:0:11533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3c85670800/0x20c3e53e78bb1e19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf7f expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947533.383871:0:11533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b3c85670800/0x20c3e53e78bb1e19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf7f expref: 12 pid: 5790 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947533.383882:0:11533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870604319906688:192.168.203.32@tcp:104: 00010000:00010000:0.0:1783947533.383912:0:11533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3cad73ba00/0x20c3e53e78bb1e12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1e0b expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947533.383921:0:11533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3cad73ba00/0x20c3e53e78bb1e12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1e0b expref: 18 pid: 5791 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947533.383930:0:11533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870604319906816:0@lo:104: 00000100:00100000:0.0:1783947533.383953:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783947533.383986:0:11533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3c85670c00/0x20c3e53e78bb1e04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1dfd expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947533.383994:0:11533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3c85670c00/0x20c3e53e78bb1e04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1dfd expref: 18 pid: 5789 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947533.384003:0:11533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870604319906944:0@lo:104: 00000100:00100000:0.0:1783947533.384021:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783947533.384042:0:11533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1df6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb1def expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947533.384062:0:11533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1df6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb1def expref: 18 pid: 5789 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947533.384080:0:11533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870604319907072:0@lo:104: 00000100:00100000:0.0:1783947533.384103:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947533.384113:0:11533:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85d33180 going to sleep for 11 seconds 00000100:00100000:3.0:1783947533.384244:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319907200:0@lo:400:kworker.0 00000100:00100000:3.0:1783947533.384274:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947533.384302:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319907200 00000100:00100000:3.0:1783947533.384307:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319907200 00000100:00100000:3.0:1783947533.384343:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783947533.384350:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319907200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947533.384398:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319907200:12345-0@lo:400:kworker.0 Request processed in 48us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947533.384405:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783947533.384454:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319907200:0@lo:400:kworker.0 00000100:00080000:3.0:1783947533.384478:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947533.384505:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319907328:0@lo:400:kworker.0 00000100:00100000:3.0:1783947533.384662:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947533.384690:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319907328 00000100:00100000:3.0:1783947533.384694:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319907328 00000100:00100000:3.0:1783947533.384721:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783947533.384727:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319907328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947533.384759:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319907328:12345-0@lo:400:kworker.0 Request processed in 31us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947533.384766:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1783947533.384779:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947533.384795:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319907328:0@lo:400:kworker.0 00000100:00100000:2.0:1783947533.385136:0:5780:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783947533.385158:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319906816 00000100:00100000:2.0:1783947533.385162:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319906816 00000100:00100000:2.0:1783947533.385183:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319906944 00000100:00100000:2.0:1783947533.385185:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319906944 00000100:00100000:2.0:1783947533.385194:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319907072 00000100:00100000:2.0:1783947533.385203:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319907072 00000100:00100000:2.0:1783947533.385217:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783947533.385223:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+5:11533:x1870604319906816:12345-0@lo:104: 00010000:00010000:2.0:1783947533.385237:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630c00/0x20c3e53e78bb1e0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1e12 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947533.385297:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783947533.385303:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+5:11533:x1870604319906816:12345-0@lo:104: Request processed in 80us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947533.385310:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783947533.385322:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947533.385328:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+4:11533:x1870604319906944:12345-0@lo:104: 00010000:00010000:2.0:1783947533.385336:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1dfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1e04 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947533.385376:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783947533.385381:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+4:11533:x1870604319906944:12345-0@lo:104: Request processed in 54us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947533.385386:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947533.385398:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783947533.385404:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:11533:x1870604319907072:12345-0@lo:104: 00010000:00010000:2.0:1783947533.385411:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b000/0x20c3e53e78bb1def lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1df6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947533.385464:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783947533.385470:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+3:11533:x1870604319907072:12345-0@lo:104: Request processed in 66us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947533.385475:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783947533.385675:0:11533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870604319906816:0@lo:104: 00000100:00100000:0.0:1783947533.385684:0:11533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870604319906944:0@lo:104: 00000100:00100000:0.0:1783947533.385691:0:11533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870604319907072:0@lo:104: 00010000:00010000:3.0:1783947533.385747:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783947533.385754:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630c00/0x20c3e53e78bb1e0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1e12 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.385761:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630c00 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:3.0:1783947533.385766:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630c00/0x20c3e53e78bb1e0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1e12 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.385774:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630c00/0x20c3e53e78bb1e0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1e12 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947533.385782:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630c00/0x20c3e53e78bb1e0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1e12 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947533.385787:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783947533.385826:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630c00/0x20c3e53e78bb1e0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1e12 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.385838:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947533.385856:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630c00/0x20c3e53e78bb1e0b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1e12 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.385864:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630c00/0x20c3e53e78bb1e0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1e12 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.385876:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947533.385879:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1dfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1e04 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.385884:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b600 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:3.0:1783947533.385887:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1dfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1e04 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.385894:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1dfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1e04 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947533.385900:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1dfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1e04 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947533.385906:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783947533.385935:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1dfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1e04 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.385941:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947533.385948:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1dfd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1e04 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.385953:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b600/0x20c3e53e78bb1dfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1e04 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.385967:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947533.385970:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b000/0x20c3e53e78bb1def lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb1df6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.385975:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b000 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:3.0:1783947533.385978:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b000/0x20c3e53e78bb1def lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb1df6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.385984:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b000/0x20c3e53e78bb1def lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb1df6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947533.385990:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b000/0x20c3e53e78bb1def lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb1df6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947533.385995:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783947533.386009:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b000/0x20c3e53e78bb1def lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1df6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.386014:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947533.386025:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b000/0x20c3e53e78bb1def lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1df6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.386032:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cad73b000/0x20c3e53e78bb1def lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb1df6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.386059:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947533.386060:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947533.386062:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947533.386069:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947533.386085:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c87978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319907584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947533.386121:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947533.386619:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c8797b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319907712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947533.386652:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947533.387171:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947533.387180:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319907456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947533.387214:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947533.387254:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319907584 00000100:00100000:3.0:1783947533.387260:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319907584 00010000:00010000:3.0:1783947533.387288:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3c85670c00/0x20c3e53e78bb1e04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1dfd expref: 19 pid: 5789 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947533.387319:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319907712 00000100:00100000:3.0:1783947533.387322:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319907712 00000100:00100000:0.0:1783947533.387455:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319907456 00000100:00100000:0.0:1783947533.387460:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319907456 00010000:00010000:3.0:1783947533.387700:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1df6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1def expref: 21 pid: 5789 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947533.387719:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783947533.387727:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87979500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+21:3312:x1870604319907584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783947533.387738:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947533.387743:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3c85670c00/0x20c3e53e78bb1e04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1dfd expref: 21 pid: 5789 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.387752:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3c85670c00/0x20c3e53e78bb1e04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1dfd expref: 21 pid: 5789 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.387767:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c85670c00/0x20c3e53e78bb1e04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1dfd expref: 21 pid: 5789 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.387782:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947533.387820:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87979500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+20:3312:x1870604319907584:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947533.387840:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783947533.387899:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783947533.387909:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+20:3313:x1870604319907712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947533.387918:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947533.387922:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1df6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1def expref: 20 pid: 5789 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947533.387932:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1df6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1def expref: 20 pid: 5789 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947533.387942:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cc0631a00/0x20c3e53e78bb1df6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1def expref: 20 pid: 5789 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947533.387950:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947533.387978:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319907712:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947533.387984:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1783947533.388015:0:8318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3cad73ba00/0x20c3e53e78bb1e12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1e0b expref: 19 pid: 5791 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947533.388034:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783947533.388041:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c856ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319907456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947533.388048:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947533.388051:0:8318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3cad73ba00/0x20c3e53e78bb1e12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb1e0b expref: 19 pid: 5791 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947533.388059:0:8318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3cad73ba00/0x20c3e53e78bb1e12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb1e0b expref: 19 pid: 5791 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947533.388069:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cad73ba00/0x20c3e53e78bb1e12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb1e0b expref: 19 pid: 5791 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947533.388079:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947533.388101:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c856ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:3312:x1870604319907456:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947533.388106:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783947533.388257:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c8797b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319907712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947533.388341:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319907456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947533.388350:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c87978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319907584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947533.388986:0:11533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870604319906688:192.168.203.32@tcp:104: 00000100:00100000:0.0:1783947533.391892:0:11533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870604319906560:192.168.203.32@tcp:104: 00010000:00010000:0.0:1783947533.391933:0:11533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b3c85670a00/0x20c3e53e78bb1f54 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947533.394368:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947533.394405:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947533.394523:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297852928 00000100:00100000:3.0:1783947533.394533:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297852928 00010000:00010000:3.0:1783947533.394567:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3c85670800/0x20c3e53e78bb1e19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf7f expref: 13 pid: 5790 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947533.394593:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297853056 00000100:00100000:3.0:1783947533.394596:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297853056 00010000:00010000:3.0:1783947533.394606:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3cc0630800/0x20c3e53e78bb1e20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf86 expref: 14 pid: 5789 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947533.394629:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:3.0:1783947533.394639:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83370000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d64dfe14-87c9-4273-a23c-517e593e369d+14:2353:x1870604297852928:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947533.394653:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947533.394658:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3c85670800/0x20c3e53e78bb1e19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf7f expref: 14 pid: 5790 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.394669:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3c85670800/0x20c3e53e78bb1e19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf7f expref: 14 pid: 5790 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.394687:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c85670800/0x20c3e53e78bb1e19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf7f expref: 14 pid: 5790 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.394704:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947533.394751:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83370000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d64dfe14-87c9-4273-a23c-517e593e369d+13:2353:x1870604297852928:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 113us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947533.394764:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:3.0:1783947533.394782:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:3.0:1783947533.394788:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83373b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d64dfe14-87c9-4273-a23c-517e593e369d+12:2353:x1870604297853056:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947533.394798:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947533.394803:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3cc0630800/0x20c3e53e78bb1e20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf86 expref: 12 pid: 5789 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.394811:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3cc0630800/0x20c3e53e78bb1e20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf86 expref: 12 pid: 5789 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.394820:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cc0630800/0x20c3e53e78bb1e20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf86 expref: 12 pid: 5789 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.394830:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b3c85670a00/0x20c3e53e78bb1f54 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.394837:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c85670a00/0x20c3e53e78bb1f54 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.394852:0:5784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3c85670a00/0x20c3e53e78bb1f54 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.394859:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3c85670a00/0x20c3e53e78bb1f54 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.394866:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b3c85670a00/0x20c3e53e78bb1f54 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.394873:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b3c85670a00/0x20c3e53e78bb1f54 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.394886:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670a00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947533.394891:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b3c85670a00/0x20c3e53e78bb1f54 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.394899:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b3c85670a00/0x20c3e53e78bb1f54 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.394911:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b3c85670a00/0x20c3e53e78bb1f54 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947533.394920:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947533.394940:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83373b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d64dfe14-87c9-4273-a23c-517e593e369d+11:2353:x1870604297853056:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 152us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947533.394946:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 34 00010000:00010000:0.0:1783947533.395461:0:11533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b3c85670a00/0x20c3e53e78bb1f54 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947533.395471:0:11533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b3c85670a00/0x20c3e53e78bb1f54 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947533.395478:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c85670a00/0x20c3e53e78bb1f54 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947533.627385:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947533.883349:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319907840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947533.883459:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947533.883748:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319907840 00000100:00100000:1.0:1783947533.883757:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319907840 00000100:00100000:1.0:1783947533.883808:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783947533.883817:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1870604319907840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947533.883861:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783947533.883920:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1870604319907840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947533.883927:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783947533.884085:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319907840:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783947534.650392:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783947534.905602:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783947534.905610:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3c83398800 from 7 10000000:01000000:0.0:1783947534.905615:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783947534.905669:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb1f5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947534.905681:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb1f5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947534.905691:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb1f5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947534.905719:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319907968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783947534.905785:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947534.905863:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85d33180 going to sleep for 11 seconds 00000100:00100000:1.0:1783947534.906742:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319907968 00000100:00100000:1.0:1783947534.906752:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319907968 00000100:00100000:1.0:1783947534.906812:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1783947534.906822:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:5793:x1870604319907968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947534.906836:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947534.906850:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cad73b800/0x20c3e53e78bb1f62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1f5b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947534.906874:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cad73b800/0x20c3e53e78bb1f62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1f5b expref: 17 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947534.906884:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cad73b800/0x20c3e53e78bb1f62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1f5b expref: 17 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947534.906894:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73b800, rc 0) 00000100:00100000:1.0:1783947534.906951:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319907968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947534.906957:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1783947534.907769:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319907968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947534.907790:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb1f5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1f62 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947534.907812:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb1f5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1f62 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947534.907881:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319908096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947534.907920:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947534.907960:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85d33180 going to sleep for 11 seconds 00000100:00100000:2.0:1783947534.908027:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319908096 00000100:00100000:2.0:1783947534.908033:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319908096 00000100:00100000:2.0:1783947534.908074:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1783947534.908083:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319908096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947534.908328:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319908096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947534.908352:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1783947534.908497:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319908096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947534.908528:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319908224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947534.909283:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947534.909323:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85d33180 going to sleep for 11 seconds 00000100:00100000:2.0:1783947534.909577:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319908224 00000100:00100000:2.0:1783947534.909585:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319908224 00000100:00100000:2.0:1783947534.909855:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1783947534.909864:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319908224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947534.910123:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319908224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 260us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947534.910132:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1783947534.910922:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319908224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947534.914064:0:11546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:11546:1870604319908352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947534.914150:0:11546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947534.914194:0:11546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85d33b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783947534.914273:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319908352 00000100:00100000:1.0:1783947534.914285:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319908352 00000100:00100000:1.0:1783947534.914344:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1783947534.914361:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:11546:x1870604319908352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947534.914892:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:11546:x1870604319908352:12345-0@lo:502:llog_process_th.0 Request processed in 530us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947534.914900:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1783947534.916170:0:11546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:11546:1870604319908352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783947534.916214:0:11546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947534.916225:0:11546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947534.916228:0:11546:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783947534.916238:0:11546:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b3c83398800 00000020:00000080:0.0:1783947534.916240:0:11546:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783947534.918457:0:11546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:11546:1870604319908480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947534.918546:0:11546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947534.918594:0:11546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85d33b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783947534.918889:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319908480 00000100:00100000:2.0:1783947534.918897:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319908480 00000100:00100000:2.0:1783947534.918952:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1783947534.918962:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:11546:x1870604319908480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947534.919190:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:11546:x1870604319908480:12345-0@lo:502:llog_process_th.0 Request processed in 230us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947534.919198:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1783947534.919528:0:11546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:11546:1870604319908480:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783947534.919574:0:11546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947534.919586:0:11546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947534.919588:0:11546:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783947534.919595:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1783947534.919983:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1783947534.920006:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783947534.920017:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb1f5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1f62 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947534.920030:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb1f5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1f62 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947534.920042:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783947534.920052:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3cb6183000 from 7 10000000:01000000:3.0:1783947534.920055:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783947534.920092:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c200/0x20c3e53e78bb1f69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947534.920100:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c200/0x20c3e53e78bb1f69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947534.920108:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c200/0x20c3e53e78bb1f69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947534.920130:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c8797b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319908608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947534.920180:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947534.920218:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c83610c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947534.920455:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319908608 00000100:00100000:2.0:1783947534.920461:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319908608 00000100:00100000:2.0:1783947534.920501:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1783947534.920509:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:5793:x1870604319908608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947534.920522:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947534.920535:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cc0631600/0x20c3e53e78bb1f70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1f69 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947534.920567:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cc0631600/0x20c3e53e78bb1f70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1f69 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947534.920578:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cc0631600/0x20c3e53e78bb1f70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1f69 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947534.920587:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631600, rc 0) 00000100:00100000:2.0:1783947534.920982:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319908608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 473us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947534.920990:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1783947534.926742:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c8797b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319908608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947534.926780:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c200/0x20c3e53e78bb1f69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1f70 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947534.926793:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c200/0x20c3e53e78bb1f69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1f70 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947534.926875:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c8797b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319908736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947534.926932:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947534.926973:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c83610c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947534.930222:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319908736 00000100:00100000:1.0:1783947534.930237:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319908736 00000100:00100000:1.0:1783947534.930301:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1783947534.930310:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319908736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947534.930995:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319908736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 683us (4060us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947534.931004:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1783947534.931093:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c8797b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319908736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947534.931142:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319908864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947534.931183:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947534.931218:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85d33b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783947534.940880:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319908864 00000100:00100000:1.0:1783947534.940895:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319908864 00000100:00100000:1.0:1783947534.940964:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1783947534.940974:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319908864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947534.941212:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319908864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 240us (10028us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947534.941220:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1783947534.941287:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319908864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947534.941581:0:11549:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:11549:1870604319908992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947534.941635:0:11549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947534.941659:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319908992 00000100:00100000:1.0:1783947534.941663:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319908992 00000100:00100000:1.0:1783947534.941689:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1783947534.941703:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:11549:x1870604319908992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947534.941832:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:11549:x1870604319908992:12345-0@lo:502:llog_process_th.0 Request processed in 129us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947534.941839:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1783947534.941882:0:11549:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cbd6fdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947534.941896:0:11549:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:11549:1870604319908992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783947534.941917:0:11549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947534.941925:0:11549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947534.941927:0:11549:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783947534.941933:0:11549:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b3cb6183000 00000020:00000080:1.0:1783947534.941936:0:11549:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783947534.942476:0:11549:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:11549:1870604319909120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947534.942521:0:11549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947534.942545:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319909120 00000100:00100000:1.0:1783947534.942549:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319909120 00000100:00100000:1.0:1783947534.942575:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1783947534.942582:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:11549:x1870604319909120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947534.942716:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:11549:x1870604319909120:12345-0@lo:502:llog_process_th.0 Request processed in 134us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947534.942723:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1783947534.942759:0:11549:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cbd6fdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947534.942772:0:11549:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:11549:1870604319909120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783947534.942791:0:11549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947534.942797:0:11549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947534.942798:0:11549:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1783947534.942802:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1783947534.942870:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1783947534.942889:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947534.942898:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c200/0x20c3e53e78bb1f69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1f70 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947534.942908:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c200/0x20c3e53e78bb1f69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1f70 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947534.942917:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783947534.942919:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3c85ce6800 from 7 10000000:01000000:1.0:1783947534.942922:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947534.942946:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1f77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947534.942953:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1f77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947534.942962:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1f77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947534.942975:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319909248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947534.942998:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947534.943010:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cbd6fdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947534.943022:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319909248 00000100:00100000:1.0:1783947534.943025:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319909248 00000100:00100000:1.0:1783947534.943044:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1783947534.943050:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:5793:x1870604319909248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947534.943059:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947534.943071:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cad73b200/0x20c3e53e78bb1f7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb1f77 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947534.943103:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cad73b200/0x20c3e53e78bb1f7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb1f77 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947534.943114:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cad73b200/0x20c3e53e78bb1f7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb1f77 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947534.943121:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73b200, rc 0) 00000100:00100000:1.0:1783947534.943151:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319909248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947534.943157:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1783947534.943185:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319909248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947534.943196:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1f77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1f7e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947534.943205:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1f77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1f7e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947534.943243:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319909376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947534.943266:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947534.943279:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cbd6fdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947534.943289:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319909376 00000100:00100000:1.0:1783947534.943292:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319909376 00000100:00100000:1.0:1783947534.943312:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1783947534.943319:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319909376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947534.943562:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319909376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947534.943577:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1783947534.943611:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319909376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947534.943635:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319909504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947534.943667:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947534.943680:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cbd6fdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947534.943691:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319909504 00000100:00100000:1.0:1783947534.943695:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319909504 00000100:00100000:1.0:1783947534.943715:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1783947534.943720:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319909504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947534.943831:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:5793:x1870604319909504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947534.943837:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1783947534.943875:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:5793:1870604319909504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947534.944137:0:11550:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:11550:1870604319909632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947534.944174:0:11550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947534.944192:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319909632 00000100:00100000:1.0:1783947534.944195:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319909632 00000100:00100000:1.0:1783947534.944216:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1783947534.944222:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:11550:x1870604319909632:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947534.944335:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:11550:x1870604319909632:12345-0@lo:502:llog_process_th.0 Request processed in 112us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947534.944342:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1783947534.957735:0:11550:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3ca03e6480 going to sleep for 11 seconds 00000100:00100000:1.0:1783947534.957773:0:11550:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:11550:1870604319909632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783947534.957820:0:11550:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947534.957830:0:11550:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947534.957832:0:11550:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783947534.957840:0:11550:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b3c85ce6800 00000020:00000080:1.0:1783947534.957843:0:11550:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783947534.957926:0:11550:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:11550:1870604319909760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947534.957992:0:11550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947534.958025:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319909760 00000100:00100000:1.0:1783947534.958031:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319909760 00000100:00100000:1.0:1783947534.958062:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1783947534.958070:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:11550:x1870604319909760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947534.958253:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:11550:x1870604319909760:12345-0@lo:502:llog_process_th.0 Request processed in 183us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947534.958261:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1783947534.958298:0:11550:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3ca03e6480 going to sleep for 11 seconds 00000100:00100000:1.0:1783947534.958311:0:11550:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:11550:1870604319909760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783947534.958328:0:11550:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947534.958355:0:11550:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947534.958357:0:11550:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1783947534.958361:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1783947534.958443:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1783947534.958460:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947534.958469:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1f77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1f7e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947534.958480:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1f77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1f7e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947534.967734:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783947535.301983:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947535.302079:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297853184 00000100:00100000:3.0:1783947535.302088:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297853184 00000100:00100000:3.0:1783947535.302141:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 269 00000100:00100000:3.0:1783947535.302152:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+11:5573:x1870604297853184:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947535.302168:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947535.302197:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c8147ce00/0x20c3e53e78bb1f85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aafd3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947535.302227:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c8147ce00/0x20c3e53e78bb1f85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafd3 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947535.302239:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c8147ce00/0x20c3e53e78bb1f85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafd3 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947535.302249:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147ce00, rc 0) 00000100:00100000:3.0:1783947535.302310:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+12:5573:x1870604297853184:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 161us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947535.302317:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 269 00000100:00100000:3.0:1783947535.313444:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947535.313802:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297853312 00000100:00100000:1.0:1783947535.313814:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297853312 00000100:00100000:1.0:1783947535.313873:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 270 00000100:00100000:1.0:1783947535.313884:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+12:5573:x1870604297853312:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947535.314210:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+12:5573:x1870604297853312:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 326us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947535.314219:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 270 00000100:00100000:0.0:1783947535.317173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947535.317276:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297853440 00000100:00100000:1.0:1783947535.317286:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297853440 00000100:00100000:1.0:1783947535.317357:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 271 00000100:00100000:1.0:1783947535.317368:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+12:5573:x1870604297853440:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947535.319334:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+12:5573:x1870604297853440:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 1957us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947535.319358:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 271 00000100:00100000:2.0:1783947535.331095:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947535.332792:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297853568 00000100:00100000:3.0:1783947535.332807:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297853568 00000100:00100000:3.0:1783947535.333119:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 272 00000100:00100000:3.0:1783947535.333132:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+12:9948:x1870604297853568:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783947535.333574:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+12:9948:x1870604297853568:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 443us (2493us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947535.333583:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 272 00000100:00100000:3.0:1783947535.341858:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947535.341970:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297853696 00000100:00100000:1.0:1783947535.341982:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297853696 00000100:00100000:1.0:1783947535.342038:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 273 00000100:00100000:1.0:1783947535.342048:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+12:9948:x1870604297853696:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783947535.342299:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+12:9948:x1870604297853696:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 251us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947535.342308:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 273 00000100:00100000:0.0:1783947535.347362:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947535.347467:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297853824 00000100:00100000:2.0:1783947535.347477:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297853824 00000100:00100000:2.0:1783947535.347546:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 274 00000100:00100000:2.0:1783947535.347557:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+12:5573:x1870604297853824:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947535.347583:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947535.347602:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cc0630e00/0x20c3e53e78bb1f8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aafda expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947535.347631:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cc0630e00/0x20c3e53e78bb1f8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafda expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947535.347658:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cc0630e00/0x20c3e53e78bb1f8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafda expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947535.347680:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630e00, rc 0) 00000100:00100000:2.0:1783947535.347738:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:5573:x1870604297853824:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 184us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947535.347746:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 274 00000100:00100000:2.0:1783947535.358227:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947535.358335:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297853952 00000100:00100000:3.0:1783947535.358355:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297853952 00000100:00100000:3.0:1783947535.358411:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 275 00000100:00100000:3.0:1783947535.358467:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:5573:x1870604297853952:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947535.358757:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:5573:x1870604297853952:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 336us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947535.358771:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 275 00000100:00100000:3.0:1783947535.364714:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947535.364869:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297854080 00000100:00100000:1.0:1783947535.364879:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297854080 00000100:00100000:1.0:1783947535.364956:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 276 00000100:00100000:1.0:1783947535.364966:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+13:5573:x1870604297854080:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947535.365172:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+13:5573:x1870604297854080:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 207us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947535.365181:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 276 00000100:00100000:0.0:1783947535.376233:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947535.376472:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297854208 00000100:00100000:2.0:1783947535.376483:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297854208 00000100:00100000:2.0:1783947535.376549:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 277 00000100:00100000:2.0:1783947535.376560:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:9951:x1870604297854208:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783947535.376815:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:9951:x1870604297854208:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 257us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947535.376823:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 277 00000100:00100000:2.0:1783947535.383743:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947535.383815:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297854336 00000100:00100000:3.0:1783947535.383825:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297854336 00000100:00100000:3.0:1783947535.383875:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 278 00000100:00100000:3.0:1783947535.383885:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:9951:x1870604297854336:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783947535.384166:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:9951:x1870604297854336:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 282us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947535.384174:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 278 00010000:00010000:1.0:1783947535.673607:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783947535.994102:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783947536.697980:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947537.163511:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947537.163692:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297854592 00000100:00100000:1.0:1783947537.163702:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297854592 00000100:00100000:1.0:1783947537.163767:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00100000:1.0:1783947537.163778:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c8797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297854592:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947537.163843:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c8797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297854592:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 68us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947537.163850:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00080000:0.0:1783947537.164316:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947537.164450:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947537.164509:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947537.164544:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947537.164754:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297854464 00000100:00100000:2.0:1783947537.164760:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297854464 00000100:00100000:2.0:1783947537.164800:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 279 00000100:00100000:2.0:1783947537.164809:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+13:2354:x1870604297854464:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947537.164849:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+13:2354:x1870604297854464:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 42us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947537.164856:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 279 00000100:00100000:1.0:1783947537.165100:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297854848 00000100:00100000:1.0:1783947537.165106:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297854848 00000100:00100000:1.0:1783947537.165154:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 119 00000100:00100000:1.0:1783947537.165162:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c8797bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2354:x1870604297854848:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947537.165198:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c8797bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2354:x1870604297854848:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 37us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947537.165205:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 119 00000100:00080000:2.0:1783947537.165361:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947537.173040:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297854720 00000100:00100000:0.0:1783947537.173054:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297854720 00000100:00100000:0.0:1783947537.173154:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:0.0:1783947537.173168:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c8797aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297854720:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947537.173399:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c8797aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297854720:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 234us (8853us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947537.173410:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00080000:2.0:1783947537.173584:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783947537.721594:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783947538.039967:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1783947538.491065:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319909888:0@lo:400:kworker.0 00000100:00100000:0.0:1783947538.491087:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319910144:0@lo:400:kworker.0 00000100:00100000:3.0:1783947538.491147:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319910016:0@lo:400:kworker.0 00000100:00100000:1.0:1783947538.491214:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319910272:0@lo:400:kworker.0 00000100:00100000:0.0:1783947538.495263:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947538.499990:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319910656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947538.500061:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947538.500122:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319910144 00000100:00100000:0.0:1783947538.500130:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319910144 00000100:00100000:0.0:1783947538.500185:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783947538.500195:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319910144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947538.500261:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319910144:12345-0@lo:400:kworker.0 Request processed in 69us (5006us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947538.500269:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783947538.500290:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319910656 00000100:00100000:0.0:1783947538.500306:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319910656 00000100:00100000:0.0:1783947538.500340:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783947538.500347:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319910656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947538.500373:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947538.500400:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319910656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947538.500406:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1783947538.500436:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783947538.500441:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783947538.500480:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c83373100 x1870604319910656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947554 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947538.500499:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319910656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947538.500512:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319910144:0@lo:400:kworker.0 00000100:00100000:2.0:1783947538.504696:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947538.504770:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319910400:0@lo:400:kworker.0 00000100:00100000:2.0:1783947538.504829:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947538.504911:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319910400 00000100:00100000:2.0:1783947538.504930:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319910400 00000100:00100000:2.0:1783947538.504988:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783947538.504997:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319910400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947538.505051:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319910400:12345-0@lo:400:kworker.0 Request processed in 55us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947538.505058:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783947538.505097:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319910400:0@lo:400:kworker.0 00000100:00100000:0.0:1783947538.510503:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319909888 00000100:00100000:0.0:1783947538.510518:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319909888 00000100:00100000:0.0:1783947538.510580:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1783947538.510590:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3311:x1870604319909888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947538.510685:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3311:x1870604319909888:12345-0@lo:400:kworker.0 Request processed in 97us (5997us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947538.510691:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:0.0:1783947538.510728:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947538.510776:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319909888:0@lo:400:kworker.0 00000100:00100000:3.0:1783947538.511434:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947538.511548:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319910016 00000100:00100000:0.0:1783947538.511555:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319910016 00000100:00100000:0.0:1783947538.511600:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783947538.511608:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c8797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319910016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947538.511666:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319910528:0@lo:400:kworker.0 00000100:00100000:3.0:1783947538.511695:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947538.511727:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319910528 00000100:00100000:3.0:1783947538.511731:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319910528 00000100:00100000:3.0:1783947538.511766:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783947538.511772:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319910528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947538.511804:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319910528:12345-0@lo:400:kworker.0 Request processed in 33us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947538.511823:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1783947538.511843:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947538.511862:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1783947538.511867:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b3b85daea00, transno 4294967300 00000100:00100000:3.0:1783947538.511877:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319910528:0@lo:400:kworker.0 00000100:00100000:1.0:1783947538.517817:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947538.518507:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319910272 00000100:00100000:3.0:1783947538.518518:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319910272 00000100:00100000:3.0:1783947538.518581:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783947538.518591:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319910272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947538.518677:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319910272:12345-0@lo:400:kworker.0 Request processed in 87us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947538.518684:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1783947538.518846:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c812aa680 x1870604319910272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947538.518861:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319910272:0@lo:400:kworker.0 00000100:00100000:0.0:1783947538.525244:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c8797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319910016:12345-0@lo:400:kworker.0 Request processed in 13627us (13803us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947538.525260:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783947538.525468:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319910016:0@lo:400:kworker.0 00010000:00010000:3.0:1783947538.745700:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947539.001788:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319910784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947539.001861:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947539.001984:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319910784 00000100:00100000:0.0:1783947539.001994:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319910784 00000100:00100000:0.0:1783947539.002050:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783947539.002060:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c8797b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319910784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783947539.002096:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947539.003537:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c8797b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319910784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1469us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947539.003550:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783947539.010476:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319910784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783947539.769600:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947540.793593:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947541.817681:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947542.278391:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947542.278467:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947542.278491:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947542.278513:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947542.278536:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297855104 00000100:00100000:2.0:1783947542.278545:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297855104 00000100:00100000:2.0:1783947542.278588:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297855360 00000100:00100000:2.0:1783947542.278590:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297855360 00000100:00100000:2.0:1783947542.278608:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 123 00000100:00100000:2.0:1783947542.278617:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2353:x1870604297855104:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947542.278768:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297854976 00000100:00100000:3.0:1783947542.278772:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297854976 00000100:00100000:3.0:1783947542.278805:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 281 00000100:00100000:3.0:1783947542.278812:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:2353:x1870604297854976:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947542.278870:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:2353:x1870604297854976:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 59us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947542.278877:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 281 00000100:00080000:3.0:1783947542.278921:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947542.278933:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297855232 00000100:00100000:1.0:1783947542.278946:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297855232 00000100:00100000:1.0:1783947542.278986:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:1.0:1783947542.278994:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2353:x1870604297855232:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947542.279025:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2353:x1870604297855232:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 33us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947542.279032:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:1.0:1783947542.279071:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 124 00000100:00100000:1.0:1783947542.279080:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2353:x1870604297855360:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947542.279107:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2353:x1870604297855360:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 29us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947542.279113:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 124 00000100:00080000:3.0:1783947542.279289:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947542.279375:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2353:x1870604297855104:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 758us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947542.279382:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 123 00010000:00010000:3.0:1783947542.841871:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947543.611006:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319911040:0@lo:400:kworker.0 00000100:00100000:3.0:1783947543.611074:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947543.611138:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319911552:0@lo:400:kworker.0 00000100:00100000:3.0:1783947543.611162:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947543.611195:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783947543.611201:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319910912:0@lo:400:kworker.0 00000100:00100000:3.0:1783947543.611242:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947543.611259:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319911424:0@lo:400:kworker.0 00000100:00100000:3.0:1783947543.611297:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947543.611324:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319911552 00000100:00100000:3.0:1783947543.611331:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319911552 00000100:00100000:3.0:1783947543.611380:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783947543.611389:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319911552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947543.611479:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319911552:12345-0@lo:400:kworker.0 Request processed in 90us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947543.611486:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1783947543.611506:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947543.611534:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319911552:0@lo:400:kworker.0 00000100:00100000:3.0:1783947543.611556:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319911296:0@lo:400:kworker.0 00000100:00100000:3.0:1783947543.611593:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947543.611610:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947543.611615:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319911168:0@lo:400:kworker.0 00000100:00100000:3.0:1783947543.611635:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947543.611980:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319911680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947543.612012:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947543.612037:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319910912 00000100:00100000:2.0:1783947543.612044:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319910912 00000100:00100000:1.0:1783947543.612052:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319911040 00000100:00100000:1.0:1783947543.612058:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319911040 00000100:00100000:1.0:1783947543.612094:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319911424 00000100:00100000:1.0:1783947543.612097:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319911424 00000100:00100000:2.0:1783947543.612101:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1783947543.612112:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319910912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947543.612121:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319911168 00000100:00100000:1.0:1783947543.612124:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319911168 00000100:00100000:1.0:1783947543.612144:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783947543.612152:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319911040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947543.612172:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319910912:12345-0@lo:400:kworker.0 Request processed in 62us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947543.612181:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1783947543.612195:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319911040:12345-0@lo:400:kworker.0 Request processed in 43us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947543.612203:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783947543.612236:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783947543.612244:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319911424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947543.612300:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319911424:12345-0@lo:400:kworker.0 Request processed in 57us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947543.612382:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319910912:0@lo:400:kworker.0 00000100:00100000:3.0:1783947543.612394:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319911424:0@lo:400:kworker.0 00000100:00100000:3.0:1783947543.612406:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319911040:0@lo:400:kworker.0 00000100:00100000:2.0:1783947543.612407:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783947543.612447:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319911168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947543.612488:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319911168:12345-0@lo:400:kworker.0 Request processed in 71us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947543.612495:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783947543.612532:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319911168:0@lo:400:kworker.0 00000100:00100000:2.0:1783947543.612559:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319911296 00000100:00100000:2.0:1783947543.612562:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319911296 00000100:00100000:2.0:1783947543.612588:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783947543.612595:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c8797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319911296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947543.612632:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c8797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319911296:12345-0@lo:400:kworker.0 Request processed in 37us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947543.612639:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1783947543.612669:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c812a8380 x1870604319911296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947543.612694:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319911296:0@lo:400:kworker.0 00000100:00100000:2.0:1783947543.612729:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319911680 00000100:00100000:2.0:1783947543.612733:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319911680 00000100:00100000:2.0:1783947543.612757:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783947543.612764:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319911680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947543.612790:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947543.612828:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319911680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947543.612835:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1783947543.613208:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783947543.613213:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783947543.613253:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c83373100 x1870604319911680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947559 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947543.613279:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319911680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947543.613888:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00010000:1.0:1783947543.870078:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947544.130442:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c87978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319911808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947544.130509:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947544.139872:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319911808 00000100:00100000:3.0:1783947544.139888:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319911808 00000100:00100000:3.0:1783947544.139962:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783947544.139974:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319911808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783947544.140017:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783947544.140101:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319911808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (9591us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947544.140109:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783947544.140170:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c87978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319911808:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783947544.889950:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783947545.210065:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783947545.915401:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947546.937867:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947547.400459:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947547.400642:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297855616 00000100:00100000:0.0:1783947547.400652:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297855616 00000100:00100000:0.0:1783947547.400741:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 128 00000100:00100000:0.0:1783947547.400754:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297855616:12345-192.168.203.32@tcp:400:kworker.0 00000100:00080000:3.0:1783947547.400984:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947547.405575:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297855616:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 4803us (5140us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947547.405604:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 128 00000100:00100000:2.0:1783947547.406067:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947547.406167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947547.406549:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297855872 00000100:00100000:1.0:1783947547.406560:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297855872 00000100:00080000:3.0:1783947547.406695:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947547.407081:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 129 00000100:00100000:1.0:1783947547.407094:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2354:x1870604297855872:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947547.408917:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2354:x1870604297855872:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 1816us (2738us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947547.408931:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 129 00000100:00100000:0.0:1783947547.411022:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297855488 00000100:00100000:0.0:1783947547.411038:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297855488 00000100:00100000:0.0:1783947547.411106:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 283 00000100:00100000:0.0:1783947547.411115:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:2353:x1870604297855488:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947547.411209:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:2353:x1870604297855488:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 88us (5137us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947547.411217:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 283 00000100:00100000:2.0:1783947547.420856:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947547.426227:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297855744 00000100:00100000:3.0:1783947547.426242:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297855744 00000100:00100000:3.0:1783947547.426337:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:3.0:1783947547.426346:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2353:x1870604297855744:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947547.426794:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2353:x1870604297855744:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 447us (5947us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947547.426816:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00080000:0.0:1783947547.428690:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783947547.961632:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947548.729724:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319912192:0@lo:400:kworker.0 00000100:00100000:0.0:1783947548.729791:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947548.729856:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947548.729863:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319912320:0@lo:400:kworker.0 00000100:00100000:0.0:1783947548.729890:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947548.729926:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319912192 00000100:00100000:0.0:1783947548.729933:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319912192 00000100:00100000:0.0:1783947548.729986:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783947548.729996:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319912192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947548.730042:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319912192:12345-0@lo:400:kworker.0 Request processed in 48us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947548.730049:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1783947548.730084:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947548.730115:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319912192:0@lo:400:kworker.0 00000100:00100000:3.0:1783947548.730208:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319912064:0@lo:400:kworker.0 00000100:00100000:3.0:1783947548.730237:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947548.730272:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319912576:0@lo:400:kworker.0 00000100:00100000:3.0:1783947548.730293:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947548.730308:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783947548.730314:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319911936:0@lo:400:kworker.0 00000100:00100000:3.0:1783947548.730338:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947548.730372:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319912448:0@lo:400:kworker.0 00000100:00100000:3.0:1783947548.730393:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947548.730452:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319911936 00000100:00100000:3.0:1783947548.730457:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319911936 00000100:00100000:3.0:1783947548.730481:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1783947548.730487:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319911936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947548.730522:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319911936:12345-0@lo:400:kworker.0 Request processed in 34us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947548.730528:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1783947548.730553:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319912064 00000100:00100000:3.0:1783947548.730557:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319912064 00000100:00100000:3.0:1783947548.730574:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319912448 00000100:00100000:3.0:1783947548.730576:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319912448 00000100:00100000:3.0:1783947548.730595:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1783947548.730601:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319912064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947548.730628:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319912064:12345-0@lo:400:kworker.0 Request processed in 28us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947548.730650:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1783947548.730669:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783947548.730675:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c8797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319912448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947548.730703:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c8797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319912448:12345-0@lo:400:kworker.0 Request processed in 29us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947548.730709:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783947548.730734:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319911936:0@lo:400:kworker.0 00000100:00100000:3.0:1783947548.730743:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319912448:0@lo:400:kworker.0 00000100:00100000:3.0:1783947548.730752:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319912064:0@lo:400:kworker.0 00000100:00080000:0.0:1783947548.730885:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947548.731108:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319912320 00000100:00100000:2.0:1783947548.731113:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319912320 00000100:00100000:2.0:1783947548.731160:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319912576 00000100:00100000:2.0:1783947548.731163:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319912576 00000100:00100000:2.0:1783947548.731185:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783947548.731192:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319912320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947548.731236:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319912320:12345-0@lo:400:kworker.0 Request processed in 45us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947548.731244:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783947548.731265:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783947548.731272:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319912576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947548.731305:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319912576:12345-0@lo:400:kworker.0 Request processed in 33us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947548.731318:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1783947548.731367:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c812a8700 x1870604319912320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947548.731378:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319912320:0@lo:400:kworker.0 00000100:00080000:0.0:1783947548.731521:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783947548.731530:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947548.731585:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319912576:0@lo:400:kworker.0 00000100:00100000:0.0:1783947548.731777:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947548.731788:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319912704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947548.731823:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947548.731941:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319912704 00000100:00100000:1.0:1783947548.731947:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319912704 00000100:00100000:1.0:1783947548.731996:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783947548.732004:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319912704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783947548.732032:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783947548.732079:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319912704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947548.732085:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1783947548.732155:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd443480 x1870604319912704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947564 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947548.732169:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319912704:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783947548.985827:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947549.241712:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947549.241738:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c87979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319912832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947549.241832:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947549.241860:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319912832 00000100:00100000:3.0:1783947549.241869:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319912832 00000100:00100000:3.0:1783947549.241928:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783947549.241937:0:6593:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1783947549.241938:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319912832:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947549.241949:0:6593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1783947549.241978:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783947549.242030:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319912832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947549.242038:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783947549.242089:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c87979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319912832:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783947550.009643:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947551.033890:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947552.057979:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947552.522274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947552.522325:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947552.522454:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297856128 00000100:00100000:3.0:1783947552.522464:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297856128 00000100:00100000:3.0:1783947552.522548:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 133 00000100:00100000:3.0:1783947552.522558:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2356:x1870604297856128:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947552.522645:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2356:x1870604297856128:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 89us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947552.522653:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 133 00000100:00100000:0.0:1783947552.523042:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297856000 00000100:00100000:0.0:1783947552.523047:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297856000 00000100:00100000:0.0:1783947552.523089:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 285 00000100:00100000:0.0:1783947552.523097:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:2356:x1870604297856000:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947552.523141:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:2356:x1870604297856000:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 45us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947552.523148:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 285 00000100:00080000:1.0:1783947552.523611:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947552.532389:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947552.532486:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947552.532629:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297856256 00000100:00100000:2.0:1783947552.532639:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297856256 00000100:00100000:2.0:1783947552.532714:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:2.0:1783947552.532724:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2352:x1870604297856256:12345-192.168.203.32@tcp:9:kworker.0 00000020:00000080:2.0:1783947552.532769:0:8151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1ec8 00000100:00080000:2.0:1783947552.532778:0:8151:0:(import.c:65:import_set_state_nolock()) ffff8b3ca0bdb000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783947552.532816:0:8151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1783947552.533684:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+2:2352:x1870604297856256:12345-192.168.203.32@tcp:9:kworker.0 Request processed in 957us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947552.533696:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:0.0:1783947552.533923:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297856384 00000100:00100000:0.0:1783947552.533931:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297856384 00000100:00100000:0.0:1783947552.533983:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 134 00000100:00100000:0.0:1783947552.533991:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2355:x1870604297856384:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947552.534038:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2355:x1870604297856384:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 47us (1551us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947552.534045:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 134 00010000:00010000:3.0:1783947552.534279:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783947552.534543:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947552.534549:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783947553.084492:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783947553.418738:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d1ed966c-3190-4795-821d-ae5dca7b5f51 00000020:00000080:0.0:1783947553.418748:0:7509:0:(genops.c:906:class_export_put()) final put ffff8b3b85d9b800/d1ed966c-3190-4795-821d-ae5dca7b5f51 00000020:00000080:1.0:1783947553.418775:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3b85d9b800/d1ed966c-3190-4795-821d-ae5dca7b5f51 for lustre-OST0001 00000020:00000080:1.0:1783947553.418840:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3ca0bdb000 for lustre-OST0001 00000100:00100000:2.0:1783947553.849675:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319912960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947553.849741:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947553.849845:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319912960 00000100:00100000:0.0:1783947553.849853:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319912960 00000100:00100000:0.0:1783947553.849911:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783947553.849934:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319912960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947553.849977:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1783947553.850039:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947553.851652:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319912960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1714us (1904us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947553.851668:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1783947553.851755:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd03b800 x1870604319912960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947553.851779:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319912960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947553.853341:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c87979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319913088:0@lo:400:kworker.0 00000100:00100000:1.0:1783947553.853519:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947553.853801:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319913088 00000100:00100000:0.0:1783947553.853813:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319913088 00000100:00100000:0.0:1783947553.853863:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1783947553.853872:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319913088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947553.854822:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c8797b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319913216:0@lo:400:kworker.0 00000100:00100000:2.0:1783947553.854891:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947553.854936:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947553.854943:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85daea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319913344:0@lo:400:kworker.0 00000100:00100000:2.0:1783947553.854967:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947553.854998:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319913216 00000100:00100000:2.0:1783947553.855004:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319913216 00000100:00100000:2.0:1783947553.855053:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319913344 00000100:00100000:2.0:1783947553.855057:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319913344 00000100:00100000:2.0:1783947553.855088:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783947553.855591:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319913216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947553.855773:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319913216:12345-0@lo:400:kworker.0 Request processed in 676us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947553.855785:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783947553.855813:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783947553.855825:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319913344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947553.855862:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319913344:12345-0@lo:400:kworker.0 Request processed in 43us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947553.855872:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783947553.855922:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85daea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319913344:0@lo:400:kworker.0 00000100:00100000:2.0:1783947553.855936:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c8797b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319913216:0@lo:400:kworker.0 00000100:00100000:2.0:1783947553.855966:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319913472:0@lo:400:kworker.0 00000100:00100000:2.0:1783947553.855991:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947553.856089:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319913472 00000100:00100000:2.0:1783947553.856094:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319913472 00000100:00100000:2.0:1783947553.856983:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783947553.856996:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319913472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947553.859796:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319913472:12345-0@lo:400:kworker.0 Request processed in 2794us (3794us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947553.859811:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783947553.859889:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319913472:0@lo:400:kworker.0 00000100:00100000:0.0:1783947553.860640:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319913088:12345-0@lo:400:kworker.0 Request processed in 6765us (7117us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947553.860652:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c87979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319913088:0@lo:400:kworker.0 00000100:00100000:0.0:1783947553.860652:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:1.0:1783947553.860682:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947553.861033:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783947553.867873:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319913600:0@lo:400:kworker.0 00000100:00100000:2.0:1783947553.867948:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947553.868757:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319913600 00000100:00100000:0.0:1783947553.868767:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319913600 00000100:00100000:0.0:1783947553.868880:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783947553.868892:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319913600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947553.868960:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319913600:12345-0@lo:400:kworker.0 Request processed in 71us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947553.868968:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783947553.869022:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319913600:0@lo:400:kworker.0 00000100:00080000:1.0:1783947553.872005:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783947554.107041:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947554.367046:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947554.367069:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319913728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947554.367135:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947554.367360:0:11568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319913728 00000100:00100000:1.0:1783947554.367377:0:11568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319913728 00000100:00100000:1.0:1783947554.367452:0:11568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783947554.367461:0:11568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319913728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947554.367494:0:11568:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783947554.367541:0:11568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319913728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947554.367548:0:11568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783947554.367635:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319913728:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783947555.133635:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783947555.450947:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783947556.153657:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947557.178166:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947557.650926:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947557.650974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947557.651005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947557.651045:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297856512 00000100:00100000:2.0:1783947557.651054:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297856512 00000100:00100000:1.0:1783947557.651105:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297856640 00000100:00100000:1.0:1783947557.651110:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297856640 00000100:00100000:2.0:1783947557.651120:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 287 00000100:00100000:2.0:1783947557.651131:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:2354:x1870604297856512:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947557.651151:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297856768 00000100:00100000:1.0:1783947557.651156:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297856768 00000100:00100000:1.0:1783947557.651183:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 138 00000100:00100000:1.0:1783947557.651203:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297856640:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947557.651215:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:2354:x1870604297856512:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 86us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947557.651224:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 287 00000100:00100000:1.0:1783947557.651246:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297856640:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 55us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947557.651265:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 138 00000100:00100000:2.0:1783947557.651280:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 139 00000100:00100000:2.0:1783947557.651291:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2354:x1870604297856768:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947557.651323:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2354:x1870604297856768:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 35us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947557.651329:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 139 00000100:00080000:0.0:1783947557.652272:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1783947557.876327:0:11716:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:59:15 (1783947555) 00010000:00010000:3.0:1783947558.203724:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947558.969864:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947558.969888:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c8797b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319913856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947558.969961:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947558.970103:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319913856 00000100:00100000:2.0:1783947558.970123:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319913856 00000100:00100000:2.0:1783947558.970199:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783947558.970208:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85daea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319913856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947558.970241:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947558.970286:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85daea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319913856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947558.970293:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1783947558.970348:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783947558.970435:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3c8797b480 x1870604319913856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947558.970453:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c8797b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319913856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947558.971272:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319914240:0@lo:400:kworker.0 00000100:00100000:3.0:1783947558.971312:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947558.971339:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947558.971344:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319914368:0@lo:400:kworker.0 00000100:00100000:3.0:1783947558.971378:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947558.971447:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319913984:0@lo:400:kworker.0 00000100:00100000:0.0:1783947558.971477:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947558.971507:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319914496:0@lo:400:kworker.0 00000100:00100000:0.0:1783947558.971528:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947558.971541:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947558.971545:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319914112:0@lo:400:kworker.0 00000100:00100000:0.0:1783947558.971561:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947558.971584:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319914240 00000100:00100000:0.0:1783947558.971589:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319914240 00000100:00100000:0.0:1783947558.971623:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319914368 00000100:00100000:0.0:1783947558.971625:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319914368 00000100:00100000:0.0:1783947558.971641:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319914112 00000100:00100000:0.0:1783947558.971643:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319914112 00000100:00100000:0.0:1783947558.971655:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783947558.971661:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319914240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947558.971700:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319914240:12345-0@lo:400:kworker.0 Request processed in 39us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947558.971706:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783947558.971720:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783947558.971725:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319914368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947558.971750:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319914368:12345-0@lo:400:kworker.0 Request processed in 26us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947558.971755:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783947558.971765:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1783947558.971770:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319914112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947558.971827:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319914112:12345-0@lo:400:kworker.0 Request processed in 56us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947558.971832:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:0.0:1783947558.971854:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947558.971877:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319914112:0@lo:400:kworker.0 00000100:00100000:3.0:1783947558.972011:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319913984 00000100:00100000:3.0:1783947558.972015:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319913984 00000100:00100000:3.0:1783947558.972045:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1783947558.972051:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3311:x1870604319913984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947558.972084:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3311:x1870604319913984:12345-0@lo:400:kworker.0 Request processed in 34us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947558.972090:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1783947558.972124:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319913984:0@lo:400:kworker.0 00000100:00100000:3.0:1783947558.972141:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319914368:0@lo:400:kworker.0 00000100:00100000:3.0:1783947558.972149:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319914240:0@lo:400:kworker.0 00000100:00100000:2.0:1783947558.972328:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319914496 00000100:00100000:2.0:1783947558.972333:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319914496 00000100:00100000:2.0:1783947558.972376:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783947558.972382:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319914496:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783947558.972531:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947558.972600:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319914496:12345-0@lo:400:kworker.0 Request processed in 218us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947558.972607:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783947558.973672:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319914496:0@lo:400:kworker.0 00010000:00010000:0.0:1783947559.225580:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947559.483512:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947559.483533:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319914624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947559.483598:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947559.483934:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319914624 00000100:00100000:2.0:1783947559.483942:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319914624 00000100:00100000:2.0:1783947559.483994:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783947559.484003:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319914624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783947559.484036:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947559.484084:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319914624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947559.484092:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783947559.484139:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319914624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947559.671337:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947559.671456:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297856896 00000100:00100000:2.0:1783947559.671467:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297856896 00000100:00100000:2.0:1783947559.671557:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:2.0:1783947559.671571:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:10220:x1870604297856896:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947559.671616:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947559.671642:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb1f93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aafe1 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.671724:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb1f9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.671740:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb1f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.671755:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb1f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947559.671961:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783947559.671966:0:6613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783947559.672073:0:6613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb1f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.672098:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb1f93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafe1 expref: 7 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.672114:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb1f9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafe1 expref: 6 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.672122:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84bc6a00) 00010000:00010000:2.0:1783947559.672125:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947559.672128:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630a00, rc 0) 00000100:00100000:2.0:1783947559.672200:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:10220:x1870604297856896:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 633us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947559.672208:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00080000:1.0:1783947559.672367:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947559.684120:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947559.684318:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297857024 00000100:00100000:1.0:1783947559.684341:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297857024 00000100:00100000:1.0:1783947559.684414:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:1.0:1783947559.684472:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c8797b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:10221:x1870604297857024:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947559.684508:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947559.684536:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb1fa1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aafe8 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.684616:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb1fa8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.684632:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb1fa8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.684645:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb1fa8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.684660:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb1faf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.684668:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb1faf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.684691:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb1faf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685174:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ba00/0x20c3e53e78bb1fb6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685194:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ba00/0x20c3e53e78bb1fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685202:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ba00/0x20c3e53e78bb1fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947559.685298:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1783947559.685304:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783947559.685390:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ba00/0x20c3e53e78bb1fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685404:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb1fa8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685411:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb1fa8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685457:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb1fa8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685464:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947559.685468:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb1fa8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685476:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb1fa8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685497:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84bc6a00) 00010000:00010000:1.0:1783947559.685501:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947559.685506:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb1fa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685512:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb1fa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685528:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb1faf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685535:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb1faf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685540:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb1faf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685546:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947559.685549:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb1faf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685556:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb1faf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685563:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8b3c82977f00) 00010000:00010000:1.0:1783947559.685565:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947559.685568:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb1faf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685574:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb1faf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685627:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb1fa1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafe8 expref: 8 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685643:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ba00/0x20c3e53e78bb1fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafe8 expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947559.685651:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b3c82977300) 00010000:00010000:1.0:1783947559.685653:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947559.685655:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73ba00, rc 0) 00000100:00100000:1.0:1783947559.685750:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c8797b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:10221:x1870604297857024:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 1279us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947559.685761:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:3.0:1783947559.694415:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947559.694895:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297857280 00000100:00100000:2.0:1783947559.694912:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297857280 00000100:00100000:2.0:1783947559.695010:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:2.0:1783947559.695022:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:10221:x1870604297857280:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947559.695051:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947559.695080:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb1fbd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aafef expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.695192:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb1fc4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.695211:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb1fc4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.695226:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb1fc4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.695402:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1fcb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.695447:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1fcb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.695459:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1fcb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.697948:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631200/0x20c3e53e78bb1fd2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.697970:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631200/0x20c3e53e78bb1fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.697990:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631200/0x20c3e53e78bb1fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947559.698004:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1783947559.698378:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb1fc4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.698387:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb1fc4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.698394:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb1fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.698400:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947559.698404:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb1fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.698412:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb1fc4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.698571:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b3c82977300) 00010000:00010000:2.0:1783947559.698575:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947559.698582:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb1fc4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.698588:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb1fc4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.698664:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1fcb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.698671:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1fcb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.698683:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1fcb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.698762:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947559.698766:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1fcb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.698772:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1fcb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.698780:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8b3c84bc6c00) 00010000:00010000:2.0:1783947559.698783:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947559.698786:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1fcb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.698791:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb1fcb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.699991:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb1fbd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafef expref: 10 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.700013:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631200/0x20c3e53e78bb1fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafef expref: 9 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947559.700022:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b3c84bc6300) 00010000:00010000:2.0:1783947559.700024:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947559.700027:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631200, rc 0) 00000100:00100000:2.0:1783947559.700106:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:10221:x1870604297857280:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 5085us (5705us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783947559.700125:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:0.0:1783947559.703217:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947559.703919:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297857408 00000100:00100000:1.0:1783947559.703933:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297857408 00000100:00100000:1.0:1783947559.704012:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:1.0:1783947559.704025:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:10221:x1870604297857408:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1783947559.704184:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:10221:x1870604297857408:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 Request processed in 153us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947559.704192:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 35 00010000:00010000:3.0:1783947560.250849:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783947560.577052:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783947561.277161:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947561.762961:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947561.765256:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297857536 00000100:00100000:1.0:1783947561.765271:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297857536 00000100:00100000:1.0:1783947561.765360:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:1.0:1783947561.765372:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:10263:x1870604297857536:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1783947561.765393:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947561.765412:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb1fe0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aaff6 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783947561.765413:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783947561.765505:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1fe7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.765520:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1fe7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.765533:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1fe7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.765547:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb1fee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.765554:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb1fee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.765561:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb1fee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.765844:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1fe7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.765853:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1fe7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.765859:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1fe7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.765865:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73bc00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947561.765869:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1fe7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.765889:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1fe7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.765903:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84bc6a00) 00010000:00010000:1.0:1783947561.765907:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947561.765912:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1fe7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.765920:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb1fe7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.765932:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb1fee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.765938:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb1fee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.765943:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb1fee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.765948:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947561.765951:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb1fee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.765956:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb1fee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.765963:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8b3c82977200) 00010000:00010000:1.0:1783947561.765965:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947561.765968:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb1fee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.765984:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb1fee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.766017:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb1fe0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaff6 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.766028:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84bc6a00) 00010000:00010000:1.0:1783947561.766030:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947561.766034:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb1fe0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaff6 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.766043:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a800, rc 0) 00000100:00100000:1.0:1783947561.766115:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:10263:x1870604297857536:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 746us (3164us total) trans 0 rc 301/301 00000100:00100000:1.0:1783947561.766123:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:0.0:1783947561.776241:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947561.776381:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297857792 00000100:00100000:2.0:1783947561.776391:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297857792 00000100:00100000:3.0:1783947561.776891:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:3.0:1783947561.776904:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:10263:x1870604297857792:12345-192.168.203.32@tcp:36:lfs.0 00010000:00010000:3.0:1783947561.776962:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947561.776988:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb1f9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafe1 expref: 9 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.777003:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84bc6a00) 00010000:00010000:3.0:1783947561.777015:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947561.777279:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1ff5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.777292:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1ff5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.777301:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1ff5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.777313:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1ffc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.777335:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1ffc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.777342:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1ffc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947561.786613:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1783947561.786637:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1ff5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.786649:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1ff5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.786656:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1ff5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.786661:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147ca00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947561.786665:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1ff5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.787215:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1ff5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.787233:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84af9b00) 00010000:00010000:3.0:1783947561.787237:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947561.787242:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1ff5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.787248:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb1ff5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783947561.787291:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000081d01267 reply state 0000000071804e33 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1ffc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947561.787302:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783947561.787732:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+10:10263:x1870604297857792:12345-192.168.203.32@tcp:36:lfs.0 Request processed in 10825us (11495us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783947561.787742:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 37 00010000:00010000:3.0:1783947561.791937:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1ffc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.791952:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1ffc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.791960:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1ffc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.791965:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147d000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947561.791971:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1ffc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.791978:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1ffc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.791997:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8b3c84af9a00) 00010000:00010000:3.0:1783947561.792000:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947561.792005:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1ffc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.792011:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb1ffc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947561.897242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947561.897277:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297857920 00000100:00100000:3.0:1783947561.897292:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297857920 00000100:00100000:3.0:1783947561.897361:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:3.0:1783947561.897370:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:10271:x1870604297857920:12345-192.168.203.32@tcp:101:lctl.0 00010000:00010000:3.0:1783947561.897407:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947561.897451:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb2003 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852aaffd expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.897517:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb200a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.897531:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb200a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.897543:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb200a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947561.897603:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783947561.897608:0:6613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947561.897649:0:6613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb200a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.897674:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb2003 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaffd expref: 11 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.897689:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb200a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaffd expref: 10 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947561.897699:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84af9a00) 00010000:00010000:3.0:1783947561.897702:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947561.897706:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147ca00, rc 0) 00000100:00100000:3.0:1783947561.897776:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+10:10271:x1870604297857920:12345-192.168.203.32@tcp:101:lctl.0 Request processed in 407us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947561.897783:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:2.0:1783947561.971027:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947561.971120:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297858048 00000100:00100000:0.0:1783947561.971130:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297858048 00000100:00100000:0.0:1783947561.971196:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:0.0:1783947561.971207:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+10:10277:x1870604297858048:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1783947561.971227:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947561.971246:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb2011 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab004 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971310:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2018 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971337:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2018 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971348:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2018 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971363:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb201f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971402:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb201f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971409:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb201f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971548:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671a00/0x20c3e53e78bb2026 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971555:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671a00/0x20c3e53e78bb2026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971562:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671a00/0x20c3e53e78bb2026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947561.971599:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1783947561.971603:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783947561.971637:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671a00/0x20c3e53e78bb2026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971648:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2018 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971654:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2018 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971660:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2018 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971670:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947561.971675:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2018 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971688:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2018 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971699:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84af9a00) 00010000:00010000:0.0:1783947561.971702:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947561.971705:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2018 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971711:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2018 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971726:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb201f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971731:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb201f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971736:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb201f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971740:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947561.971743:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb201f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971748:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb201f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971754:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8b3c8281b200) 00010000:00010000:0.0:1783947561.971756:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947561.971759:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb201f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971771:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb201f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971799:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb2011 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab004 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971812:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671a00/0x20c3e53e78bb2026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab004 expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947561.971818:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:0.0:1783947561.971821:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783947561.971823:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671a00, rc 0) 00000100:00100000:0.0:1783947561.971886:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+11:10277:x1870604297858048:12345-192.168.203.32@tcp:101:bash.0 Request processed in 680us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947561.971893:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:1.0:1783947561.983247:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947561.983336:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297858304 00000100:00100000:3.0:1783947561.983347:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297858304 00000100:00100000:3.0:1783947561.983404:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:3.0:1783947561.983415:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+11:10277:x1870604297858304:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1783947561.983474:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947561.983496:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb202d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab00b expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947561.983751:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2034 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947561.983767:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2034 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947561.983777:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2034 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947561.983820:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630800/0x20c3e53e78bb203b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947561.983829:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630800/0x20c3e53e78bb203b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947561.983835:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630800/0x20c3e53e78bb203b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783947561.984682:0:6613:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1783947561.984876:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb2042 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947561.984889:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb2042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947561.984908:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb2042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947561.984945:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2034 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947561.984952:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2034 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947561.984958:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2034 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947561.984963:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631a00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947561.984968:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2034 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947561.984974:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2034 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947561.984984:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:2.0:1783947561.984987:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947561.984991:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2034 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947561.984997:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2034 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783947561.985009:0:6613:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000077502943 reply state 00000000bddb98c3 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630800/0x20c3e53e78bb203b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947561.985017:0:6613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783947561.985055:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb202d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab00b expref: 14 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947561.985070:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb2042 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab00b expref: 13 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947561.985077:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6000) 00010000:00010000:2.0:1783947561.985079:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947561.985082:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630c00, rc 0) 00000100:00100000:2.0:1783947561.985170:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:10277:x1870604297858304:12345-192.168.203.32@tcp:101:bash.0 Request processed in 1748us (1925us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1783947561.985179:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 40 00010000:00010000:1.0:1783947561.989780:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630800/0x20c3e53e78bb203b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.989796:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630800/0x20c3e53e78bb203b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.989804:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630800/0x20c3e53e78bb203b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.989810:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947561.989815:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630800/0x20c3e53e78bb203b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.989840:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630800/0x20c3e53e78bb203b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.989856:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b3c84bc6c00) 00010000:00010000:1.0:1783947561.989859:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947561.989863:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630800/0x20c3e53e78bb203b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947561.989870:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630800/0x20c3e53e78bb203b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947561.999886:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947562.000142:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297858432 00000100:00100000:0.0:1783947562.000152:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297858432 00000100:00100000:0.0:1783947562.000220:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:0.0:1783947562.000228:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1870604297858432:12345-192.168.203.32@tcp:8:bash.0 00010000:00080000:0.0:1783947562.000261:0:6590:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp t0 exp 0000000000000000 cur 377 last 0 00000020:00000080:0.0:1783947562.000292:0:6590:0:(genops.c:1406:class_connect()) connect: client d1ed966c-3190-4795-821d-ae5dca7b5f51, cookie 0x20c3e53e78bb2050 00002000:00100000:0.0:1783947562.000303:0:6590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d1ed966c-3190-4795-821d-ae5dca7b5f51/ffff8b3c84c99000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783947562.000336:0:6590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783947562.000953:0:6590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783947562.000984:0:6590:0:(import.c:65:import_set_state_nolock()) ffff8b3c90d68800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947562.001057:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2352:x1870604297858432:12345-192.168.203.32@tcp:8:bash.0 Request processed in 827us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947562.001066:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:3.0:1783947562.007961:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947562.008207:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297858560 00000100:00100000:2.0:1783947562.008218:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297858560 00000100:00100000:2.0:1783947562.008298:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:2.0:1783947562.008308:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:0:x1870604297858560:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1783947562.008326:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947562.008351:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004515bda1/0x20c3e53e78bb2057 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab012 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783947562.008378:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783947562.008395:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1783947562.008400:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947562.008409:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004515bda1/0x20c3e53e78bb2057 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab012 expref: 7 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.008468:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004515bda1/0x20c3e53e78bb2057 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab012 expref: 7 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.008495:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631a00, rc 0) 00000100:00100000:2.0:1783947562.008544:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:0:x1870604297858560:12345-192.168.203.32@tcp:101:bash.0 Request processed in 238us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947562.008552:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00080000:0.0:1783947562.012627:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947562.019955:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947562.020045:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297858688 00000100:00100000:2.0:1783947562.020055:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297858688 00000100:00100000:2.0:1783947562.020112:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:2.0:1783947562.020122:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:10277:x1870604297858688:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1783947562.020139:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947562.020156:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc7f980c/0x20c3e53e78bb205e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab019 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.020201:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004515bda1/0x20c3e53e78bb2057 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab012 expref: 8 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.020224:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947562.020229:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947562.020234:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc7f980c/0x20c3e53e78bb205e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab019 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.020265:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004515bda1/0x20c3e53e78bb2057 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab012 expref: 8 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.020277:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004515bda1/0x20c3e53e78bb2057 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab012 expref: 8 pid: 6591 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947562.020304:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1870604319914752:192.168.203.32@tcp:104: 00000100:00100000:2.0:1783947562.020676:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb6ba0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783947562.024138:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947562.024239:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297858816 00000100:00100000:3.0:1783947562.024250:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297858816 00010000:00010000:3.0:1783947562.024295:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004515bda1/0x20c3e53e78bb2057 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab012 expref: 9 pid: 6591 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947562.024342:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:3.0:1783947562.024351:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2353:x1870604297858816:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947562.024366:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947562.024387:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004515bda1/0x20c3e53e78bb2057 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab012 expref: 9 pid: 6591 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.024452:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004515bda1/0x20c3e53e78bb2057 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab012 expref: 9 pid: 6591 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.024489:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947562.024494:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947562.024502:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc7f980c/0x20c3e53e78bb205e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab019 expref: 9 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.024512:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc7f980c/0x20c3e53e78bb205e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab019 expref: 9 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.024545:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fc7f980c/0x20c3e53e78bb205e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab019 expref: 9 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947562.024559:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6701f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5782:1870604319914880:192.168.203.32@tcp:105: 00000100:00100000:3.0:1783947562.024625:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3ca02af000 going to sleep for 11 seconds 00010000:00010000:2.0:1783947562.027945:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004515bda1/0x20c3e53e78bb2057 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab012 expref: 9 pid: 6591 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947562.027969:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1870604319914752:192.168.203.32@tcp:104: 00010000:00010000:2.0:1783947562.028005:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fc7f980c/0x20c3e53e78bb205e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab019 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.028019:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630a00, rc 0) 00000100:00100000:1.0:1783947562.028212:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:10277:x1870604297858688:12345-192.168.203.32@tcp:101:bash.0 Request processed in 8089us (8262us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947562.028222:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:3.0:1783947562.029837:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6701f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5782:1870604319914880:192.168.203.32@tcp:105: 00010000:00010000:3.0:1783947562.029858:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947562.029939:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2353:x1870604297858816:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 5588us (5809us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947562.029949:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:2.0:1783947562.034702:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947562.035460:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297859072 00000100:00100000:1.0:1783947562.035473:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297859072 00000100:00100000:1.0:1783947562.035538:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:1.0:1783947562.035549:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:10277:x1870604297859072:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:1.0:1783947562.035917:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:10277:x1870604297859072:12345-192.168.203.32@tcp:35:bash.0 Request processed in 368us (1224us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1783947562.035926:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:1.0:1783947562.130032:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947562.130310:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297859328 00000100:00100000:0.0:1783947562.130347:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297859328 00000100:00100000:0.0:1783947562.130790:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:0.0:1783947562.130803:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:10287:x1870604297859328:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1783947562.130829:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947562.130850:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2065 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab020 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947562.130959:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1783947562.131061:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2065 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab020 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.131075:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84af9a00) 00010000:00010000:0.0:1783947562.131077:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783947562.131081:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2065 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab020 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.131096:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670000, rc 0) 00000100:00100000:0.0:1783947562.131148:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+15:10287:x1870604297859328:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 350us (1126us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1783947562.131154:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:3.0:1783947562.134714:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947562.134848:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297859584 00000100:00100000:1.0:1783947562.134858:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297859584 00000100:00100000:1.0:1783947562.134933:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:1.0:1783947562.134943:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+15:10287:x1870604297859584:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1783947562.135221:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+16:10287:x1870604297859584:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 279us (517us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1783947562.135230:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:1.0:1783947562.242310:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947562.244814:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297859712 00000100:00100000:3.0:1783947562.244829:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297859712 00000100:00100000:3.0:1783947562.244919:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:3.0:1783947562.244930:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+16:10293:x1870604297859712:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1783947562.244960:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947562.244983:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2073 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab027 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.245066:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb207a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.245089:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb207a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.245101:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb207a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947562.245179:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1783947562.245183:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947562.245211:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb207a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.245239:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2073 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab027 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.245259:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb207a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab027 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.245267:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:3.0:1783947562.245270:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947562.245273:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147d000, rc 0) 00000100:00100000:3.0:1783947562.245352:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+17:10293:x1870604297859712:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 425us (3051us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947562.245366:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:1.0:1783947562.254682:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947562.254926:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297859968 00000100:00100000:2.0:1783947562.254938:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297859968 00000100:00100000:2.0:1783947562.255003:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:2.0:1783947562.255013:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+17:10293:x1870604297859968:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1783947562.255033:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947562.255054:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2081 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab02e expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.255173:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2088 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.255191:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.255222:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947562.255235:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783947562.255376:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2081 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab02e expref: 20 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.255395:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab02e expref: 19 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.255404:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6000) 00010000:00010000:2.0:1783947562.255407:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947562.255410:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630200, rc 0) 00000100:00100000:2.0:1783947562.255592:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:10293:x1870604297859968:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 568us (906us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1783947562.255600:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:1.0:1783947562.264238:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947562.264331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947562.266770:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297860352 00000100:00100000:3.0:1783947562.266785:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297860352 00000100:00100000:3.0:1783947562.266861:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:3.0:1783947562.266871:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:10293:x1870604297860352:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1783947562.266896:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947562.266917:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2096 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab035 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.267022:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb209d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.267036:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb209d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.267046:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb209d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947562.267058:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783947562.267199:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2096 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab035 expref: 22 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.267220:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb209d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab035 expref: 21 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.267229:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6000) 00010000:00010000:3.0:1783947562.267231:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783947562.267234:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1ba00, rc 0) 00000100:00100000:3.0:1783947562.267324:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:10293:x1870604297860352:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 454us (2992us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1783947562.267331:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:2.0:1783947562.270978:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297860224 00000100:00100000:2.0:1783947562.270992:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297860224 00000100:00100000:2.0:1783947562.271080:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:2.0:1783947562.271095:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85da9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:2353:x1870604297860224:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947562.271112:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947562.271144:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2088 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab02e expref: 21 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.271171:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6000) 00010000:00010000:2.0:1783947562.271176:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947562.271323:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85da9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+20:2353:x1870604297860224:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 234us (7097us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947562.271330:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:1.0:1783947562.286800:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947562.286949:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297860480 00000100:00100000:2.0:1783947562.286959:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297860480 00000100:00100000:2.0:1783947562.287023:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:2.0:1783947562.287033:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2356:x1870604297860480:12345-192.168.203.32@tcp:1:lfs.0 00010000:00010000:2.0:1783947562.287078:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037a982ba/0x20c3e53e78bb20ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.287098:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc7f980c/0x20c3e53e78bb205e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab019 expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.287106:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947562.287110:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947562.287115:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037a982ba/0x20c3e53e78bb20ab lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.287150:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc7f980c/0x20c3e53e78bb205e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab019 expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.287176:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc7f980c/0x20c3e53e78bb205e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab019 expref: 7 pid: 6592 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947562.287190:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1870604319915008:192.168.203.32@tcp:104: 00000100:00100000:2.0:1783947562.287283:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb6ba0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783947562.295106:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947562.295234:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297860608 00000100:00100000:3.0:1783947562.295244:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297860608 00002000:00100000:3.0:1783947562.295291:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8b3b85d63800 x1870604297860608/t0(0) o4->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:353/0 lens 504/0 e 0 to 0 dl 1783947573 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783947562.295302:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3b85d63800 with x1870604297860608 ext(0->12) 00010000:00010000:3.0:1783947562.295321:0:6595:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fc7f980c/0x20c3e53e78bb205e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab019 expref: 8 pid: 6592 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.295339:0:6595:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fc7f980c/0x20c3e53e78bb205e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab019 expref: 8 pid: 6592 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947562.295347:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b3b85d63800 00000100:00100000:3.0:1783947562.295381:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1783947562.295390:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2354:x1870604297860608:12345-192.168.203.32@tcp:4:lfs.0 00000100:00100000:2.0:1783947562.295990:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1870604319915008:192.168.203.32@tcp:104: 00010000:00010000:2.0:1783947562.296020:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000037a982ba/0x20c3e53e78bb20ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.299634:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783947562.327548:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d1ed966c-3190-4795-821d-ae5dca7b5f51 00000100:00100000:1.0:1783947562.328178:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2354:x1870604297860608:12345-192.168.203.32@tcp:4:lfs.0 Request processed in 32783us (33075us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1783947562.328196:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00002000:00100000:1.0:1783947562.328210:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8b3b85d63800 x1870604297860608/t4294967299(0) o4->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:353/0 lens 504/448 e 0 to 0 dl 1783947573 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783947562.328221:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3b85d63800 with x1870604297860608 ext(0->12) 00010000:00010000:1.0:1783947562.328232:0:6595:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fc7f980c/0x20c3e53e78bb205e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab019 expref: 9 pid: 6592 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947562.328251:0:6595:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fc7f980c/0x20c3e53e78bb205e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab019 expref: 9 pid: 6592 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783947562.328260:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b3b85d63800 00000100:00100000:0.0:1783947562.331920:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947562.332016:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297860736 00000100:00100000:2.0:1783947562.332026:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297860736 00010000:00010000:2.0:1783947562.332064:0:8318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc7f980c/0x20c3e53e78bb205e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab019 expref: 9 pid: 6592 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947562.332145:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:2.0:1783947562.332154:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2355:x1870604297860736:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947562.332180:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783947562.332200:0:8318:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783947562.332203:0:8318:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1783947561 00002000:00010000:2.0:1783947562.332205:0:8318:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1783947561 00002000:00010000:2.0:1783947562.332207:0:8318:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1783947561 00010000:00010000:2.0:1783947562.332214:0:8318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc7f980c/0x20c3e53e78bb205e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab019 expref: 9 pid: 6592 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.332232:0:8318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc7f980c/0x20c3e53e78bb205e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab019 expref: 9 pid: 6592 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.332255:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc7f980c/0x20c3e53e78bb205e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab019 expref: 9 pid: 6592 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.332272:0:8318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947562.332276:0:8318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947562.332294:0:8318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000037a982ba/0x20c3e53e78bb20ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.332303:0:8318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037a982ba/0x20c3e53e78bb20ab lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.332351:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947562.332408:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2355:x1870604297860736:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 254us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947562.332451:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 36 00010000:00010000:0.0:1783947562.332515:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000037a982ba/0x20c3e53e78bb20ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.332525:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037a982ba/0x20c3e53e78bb20ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.332562:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037a982ba/0x20c3e53e78bb20ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.332570:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037a982ba/0x20c3e53e78bb20ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.332578:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037a982ba/0x20c3e53e78bb20ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.332584:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630200 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947562.332588:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037a982ba/0x20c3e53e78bb20ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.332597:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037a982ba/0x20c3e53e78bb20ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.332610:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037a982ba/0x20c3e53e78bb20ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.332617:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037a982ba/0x20c3e53e78bb20ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947562.332669:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2356:x1870604297860480:12345-192.168.203.32@tcp:1:lfs.0 Request processed in 45637us (45879us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947562.332677:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:3.0:1783947562.334559:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947562.334630:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297860992 00000100:00100000:1.0:1783947562.334639:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297860992 00000100:00100000:1.0:1783947562.334704:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:1.0:1783947562.334714:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+20:10293:x1870604297860992:12345-192.168.203.32@tcp:35:lfs.0 00000004:00010000:1.0:1783947562.334781:0:5799:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb209d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab035 expref: 20 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783947562.335117:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1783947562.335185:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1783947562.336085:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1783947562.336156:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb20b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947562.336185:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb2042 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab00b expref: 24 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947562.336194:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb20b2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947562.336230:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb2042 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab00b expref: 24 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947562.336247:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb2042 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab00b expref: 24 pid: 6613 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947562.336262:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d62a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1870604319915136:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947562.336593:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cc01ee900 going to sleep for 11 seconds 00000100:00100000:1.0:1783947562.339742:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947562.340237:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297861120 00000100:00100000:0.0:1783947562.340247:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297861120 00010000:00010000:0.0:1783947562.340287:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb2042 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab00b expref: 25 pid: 6613 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947562.340336:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:0.0:1783947562.340346:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6585880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+25:2353:x1870604297861120:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947562.340361:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947562.340369:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb2042 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab00b expref: 25 pid: 6613 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.340382:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb2042 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab00b expref: 25 pid: 6613 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.340404:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6000) 00010000:00010000:0.0:1783947562.340409:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb20b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.340455:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb20b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.340464:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb20b2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.340493:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947562.340544:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6585880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+25:2353:x1870604297861120:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 200us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947562.340551:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 37 00010000:00010000:3.0:1783947562.341952:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb2042 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab00b expref: 24 pid: 6613 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947562.341975:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d62a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1870604319915136:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947562.342285:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb20b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.342383:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb20b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.342391:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb20b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783947562.342657:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1783947562.342984:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1783947562.343114:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6701c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1870604319915264:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783947562.343395:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947562.343706:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3ca02af0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947562.343873:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319915264 00000100:00100000:1.0:1783947562.343881:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319915264 00000100:00100000:1.0:1783947562.344015:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947562.344033:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5799:x1870604319915264:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783947562.344119:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5799:x1870604319915264:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947562.344126:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1783947562.344165:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947562.344228:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6701c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1870604319915264:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783947562.345267:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1783947562.345353:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6701c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1870604319915392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783947562.345405:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947562.345762:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3ca02af240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947562.345984:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319915392 00000100:00100000:2.0:1783947562.345991:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319915392 00000100:00100000:2.0:1783947562.346038:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947562.346047:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5799:x1870604319915392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783947562.346323:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5799:x1870604319915392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 269us (908us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1783947562.346331:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947562.346727:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6701c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1870604319915392:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783947562.346792:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1783947562.346835:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb20b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.346844:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb20b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.346851:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb20b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.346856:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947562.346868:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb20b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.346876:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb20b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.346891:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6000) 00010000:00010000:3.0:1783947562.346894:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783947562.346899:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb20b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.346904:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb20b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783947562.347409:0:5799:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783947562.347893:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1783947562.347904:0:5799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 377618485489ns, next at 378618482649ns, rc = 0 00000001:00080000:3.0:1783947562.347912:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1783947562.347955:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6000) 00010000:00010000:3.0:1783947562.347959:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783947562.347967:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb209d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab035 expref: 28 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947562.348112:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+27:10293:x1870604297860992:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 13398us (13559us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1783947562.348122:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000020:00080000:3.0:1783947562.348126:0:5799:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783947562.352208:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947562.352315:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297861248 00000100:00100000:2.0:1783947562.352334:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297861248 00000100:00100000:2.0:1783947562.352454:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:2.0:1783947562.352476:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+27:10293:x1870604297861248:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1783947562.352502:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947562.352528:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb20b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab03c expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.352761:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb20b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab03c expref: 28 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.352804:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb20b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab03c expref: 28 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.352826:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:2.0:1783947562.352828:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947562.352831:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631a00, rc 0) 00000100:00100000:2.0:1783947562.352896:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+28:10293:x1870604297861248:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 433us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947562.352902:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:1.0:1783947562.357101:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947562.357238:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297861504 00000100:00100000:3.0:1783947562.357249:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297861504 00000100:00100000:3.0:1783947562.357307:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:3.0:1783947562.357325:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85b9b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+28:10293:x1870604297861504:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1783947562.357581:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85b9b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+29:10293:x1870604297861504:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 257us (488us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1783947562.357598:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:3.0:1783947562.473798:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947562.473862:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297861760 00000100:00100000:2.0:1783947562.473871:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297861760 00000100:00100000:2.0:1783947562.473932:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:2.0:1783947562.473942:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+29:10303:x1870604297861760:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1783947562.473966:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947562.473987:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb20c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab043 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947562.474125:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1783947562.474260:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb20c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab043 expref: 31 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.474275:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84af9a00) 00010000:00010000:2.0:1783947562.474279:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947562.474283:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb20c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab043 expref: 31 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.474315:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631800, rc 0) 00000100:00100000:2.0:1783947562.474390:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+30:10303:x1870604297861760:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 448us (600us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1783947562.474398:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:1.0:1783947562.481208:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947562.481455:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297861888 00000100:00100000:0.0:1783947562.481472:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297861888 00000100:00100000:0.0:1783947562.481532:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:0.0:1783947562.481543:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+30:10303:x1870604297861888:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:0.0:1783947562.481619:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb20ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.481638:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb20ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.481650:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb20ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.481665:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb20d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.481673:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb20d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.481679:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb20d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.481780:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb20dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.481788:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb20dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482131:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb20dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947562.482252:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb20dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482281:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb20ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482287:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb20ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482294:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb20ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482300:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947562.482305:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb20ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482487:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb20ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482502:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:0.0:1783947562.482505:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947562.482510:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb20ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482516:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb20ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482532:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb20d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482538:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb20d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482544:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb20d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482556:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947562.482560:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb20d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482565:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb20d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482573:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b3c8281b200) 00010000:00010000:0.0:1783947562.482576:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947562.482578:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb20d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482584:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb20d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482601:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb20dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482607:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb20dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482613:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb20dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482618:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947562.482621:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb20dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482627:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb20dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482645:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:0.0:1783947562.482648:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947562.482651:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb20dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.482656:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb20dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947562.483027:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+30:10303:x1870604297861888:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 1482us (1825us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947562.483036:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:0.0:1783947562.490173:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947562.490351:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297862144 00000100:00100000:3.0:1783947562.490362:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297862144 00000100:00100000:3.0:1783947562.490465:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:3.0:1783947562.490476:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+30:10303:x1870604297862144:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1783947562.490759:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+31:10303:x1870604297862144:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 284us (605us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1783947562.490767:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:3.0:1783947562.558819:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947562.560296:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297862400 00000100:00100000:2.0:1783947562.560310:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297862400 00000100:00100000:2.0:1783947562.560394:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:2.0:1783947562.560406:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+31:10306:x1870604297862400:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1783947562.560446:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947562.560467:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb20e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab04a expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.560543:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb20ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.560569:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb20ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.560580:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb20ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.560596:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb20f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.560602:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb20f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.560608:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb20f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.560746:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb20f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.560755:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb20f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.560761:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb20f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947562.560770:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783947562.561403:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb20ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.561413:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb20ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.561443:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb20ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.561449:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947562.561453:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb20ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.561460:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb20ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.561474:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:2.0:1783947562.561476:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947562.561481:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb20ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.561499:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb20ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.561512:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb20f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.561517:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb20f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.561522:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb20f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.561526:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630c00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947562.561529:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb20f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.561534:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb20f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.561541:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b3c84bc6b00) 00010000:00010000:2.0:1783947562.561544:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947562.561546:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb20f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.561602:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb20f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.561656:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb20e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab04a expref: 34 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.561670:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb20f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab04a expref: 33 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947562.561683:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:2.0:1783947562.561686:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947562.561688:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630a00, rc 0) 00000100:00100000:2.0:1783947562.561765:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+33:10306:x1870604297862400:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1360us (2954us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1783947562.561774:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:2.0:1783947562.564990:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947562.565081:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297862528 00000100:00100000:3.0:1783947562.565091:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297862528 00000100:00100000:3.0:1783947562.565211:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:3.0:1783947562.565221:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+33:10306:x1870604297862528:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:3.0:1783947562.565287:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2106 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.565302:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.565314:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.565341:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.565366:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2106 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.565373:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.565379:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1ba00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947562.565384:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.565391:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2106 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.565403:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:3.0:1783947562.565406:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783947562.565410:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2106 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.565456:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2106 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947562.565542:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+33:10306:x1870604297862528:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 313us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947562.565550:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:1.0:1783947562.575307:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947562.577257:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297862784 00000100:00100000:3.0:1783947562.577271:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297862784 00000100:00100000:3.0:1783947562.577378:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:3.0:1783947562.577390:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+33:10306:x1870604297862784:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1783947562.577652:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+34:10306:x1870604297862784:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 263us (2354us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1783947562.577671:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:2.0:1783947562.766236:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947562.766288:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947562.766459:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297862912 00000100:00100000:0.0:1783947562.766469:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297862912 00000100:00100000:0.0:1783947562.766528:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 289 00000100:00100000:0.0:1783947562.766538:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:2353:x1870604297862912:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947562.766629:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:2353:x1870604297862912:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 92us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947562.766636:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 289 00000100:00100000:1.0:1783947562.766727:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297863040 00000100:00100000:1.0:1783947562.766731:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297863040 00000100:00100000:1.0:1783947562.766784:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 143 00000100:00100000:1.0:1783947562.766792:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2353:x1870604297863040:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947562.766826:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2353:x1870604297863040:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 36us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947562.766832:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 143 00000100:00080000:0.0:1783947562.766892:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947562.992543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947562.992703:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297863296 00000100:00100000:0.0:1783947562.992714:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297863296 00000100:00100000:0.0:1783947562.992771:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:0.0:1783947562.992782:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+34:10337:x1870604297863296:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:0.0:1783947562.992809:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947562.992831:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb210d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab051 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.992945:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb2114 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.992960:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb2114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.992974:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb2114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947562.992984:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783947562.993114:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb210d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab051 expref: 37 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.993143:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb2114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab051 expref: 36 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947562.993151:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:0.0:1783947562.993163:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947562.993167:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671600, rc 0) 00000100:00100000:0.0:1783947562.993224:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+36:10337:x1870604297863296:12345-192.168.203.32@tcp:101:cat.0 Request processed in 444us (692us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1783947562.993232:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:2.0:1783947562.996755:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947562.996895:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947562.997021:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297863680 00000100:00100000:3.0:1783947562.997030:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297863680 00000100:00100000:1.0:1783947562.997079:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297863552 00000100:00100000:1.0:1783947562.997086:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297863552 00000100:00100000:3.0:1783947562.997101:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:3.0:1783947562.997112:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c856efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+37:2353:x1870604297863680:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947562.997128:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783947562.997129:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:1.0:1783947562.997141:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+37:10337:x1870604297863552:12345-192.168.203.32@tcp:35:cat.0 00010000:00010000:3.0:1783947562.997165:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb2114 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab051 expref: 37 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947562.997190:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:3.0:1783947562.997195:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947562.997248:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c856efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+36:2353:x1870604297863680:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 139us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947562.997255:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:1.0:1783947562.997365:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+36:10337:x1870604297863552:12345-192.168.203.32@tcp:35:cat.0 Request processed in 227us (619us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1783947562.997372:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:2.0:1783947563.061210:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947563.061467:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297863936 00000100:00100000:1.0:1783947563.061476:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297863936 00000100:00100000:1.0:1783947563.061554:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:1.0:1783947563.061565:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+36:10343:x1870604297863936:12345-192.168.203.32@tcp:101:dd.0 00010000:00010000:1.0:1783947563.061601:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947563.061604:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783947563.061631:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb207a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab027 expref: 36 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.061649:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:1.0:1783947563.061654:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947563.061668:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2122 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab058 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.061765:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2129 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.061778:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb20f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab04a expref: 36 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.061786:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2129 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.061819:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb20f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab04a expref: 36 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.061833:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb20f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab04a expref: 36 pid: 6613 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947563.061847:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6586680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1870604319915520:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947563.061961:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cc01ee540 going to sleep for 11 seconds 00000100:00080000:0.0:1783947563.062273:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947563.065833:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947563.065852:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6586680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1870604319915520:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947563.065892:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2129 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947563.065968:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297864064 00000100:00100000:0.0:1783947563.065976:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297864064 00010000:00010000:0.0:1783947563.066011:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb20f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab04a expref: 37 pid: 6613 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947563.066071:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:0.0:1783947563.066080:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6700700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+37:2354:x1870604297864064:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947563.066096:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947563.066104:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb20f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab04a expref: 37 pid: 6613 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.066115:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb20f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab04a expref: 37 pid: 6613 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.066138:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb20f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab04a expref: 37 pid: 6613 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.066160:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:0.0:1783947563.066166:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2129 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.066175:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2129 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.066182:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2129 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.066210:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947563.066303:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6700700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+36:2354:x1870604297864064:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 223us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947563.066310:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 38 00010000:00010000:3.0:1783947563.067397:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2129 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.067409:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2129 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947563.067454:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783947563.067735:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2122 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab058 expref: 37 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.067754:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2129 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab058 expref: 36 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.067777:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:3.0:1783947563.067780:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783947563.067783:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73b600, rc 0) 00000100:00100000:3.0:1783947563.067895:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+36:10343:x1870604297863936:12345-192.168.203.32@tcp:101:dd.0 Request processed in 6332us (6694us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1783947563.067961:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:3.0:1783947563.071106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947563.071245:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297864320 00000100:00100000:0.0:1783947563.071267:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297864320 00000100:00100000:0.0:1783947563.071399:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:0.0:1783947563.071409:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+36:10343:x1870604297864320:12345-192.168.203.32@tcp:36:dd.0 00010000:00010000:0.0:1783947563.071709:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2137 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.071726:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.071738:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783947563.071786:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1783947563.071810:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000442fb27 reply state 0000000025ad65dc transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947563.071820:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783947563.072188:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+39:10343:x1870604297864320:12345-192.168.203.32@tcp:36:dd.0 Request processed in 778us (1089us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1783947563.072196:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 52 00000020:00080000:0.0:1783947563.072202:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783947563.075136:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.075161:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2137 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.075169:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2137 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.075175:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947563.075180:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2137 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.075188:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2137 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.075205:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:3.0:1783947563.075208:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947563.075213:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2137 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.075219:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2137 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.322161:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947563.326137:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947563.326231:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297864448 00000100:00100000:0.0:1783947563.326241:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297864448 00000100:00100000:0.0:1783947563.326310:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:0.0:1783947563.326321:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb660a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+38:10358:x1870604297864448:12345-192.168.203.32@tcp:101:stat.0 00010000:00010000:0.0:1783947563.326346:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947563.326365:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb213e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab05f expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.326739:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2145 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.326755:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2145 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.326766:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2145 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.326780:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb214c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.326787:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb214c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.326865:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb214c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.326959:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2153 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.326971:0:6613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2129 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab058 expref: 39 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.326979:0:6613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2153 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.327013:0:6613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2129 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab058 expref: 39 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.327041:0:6613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2129 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab058 expref: 39 pid: 5797 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947563.327055:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6613:1870604319915648:192.168.203.32@tcp:104: 00000100:00100000:0.0:1783947563.327238:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cbd501180 going to sleep for 11 seconds 00000100:00100000:2.0:1783947563.335199:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947563.335958:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297864704 00000100:00100000:1.0:1783947563.335969:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297864704 00000100:00100000:1.0:1783947563.336037:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:1.0:1783947563.336047:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+40:5571:x1870604297864704:12345-192.168.203.32@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783947563.336884:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+41:5571:x1870604297864704:12345-192.168.203.32@tcp:35:ldlm_bl.0 Request processed in 832us (1688us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1783947563.336894:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:0.0:1783947563.338283:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6613:1870604319915648:192.168.203.32@tcp:104: 00000100:00100000:2.0:1783947563.339867:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947563.339993:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297864832 00000100:00100000:3.0:1783947563.340001:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297864832 00010000:00010000:3.0:1783947563.340043:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2129 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab058 expref: 41 pid: 5797 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947563.340084:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:3.0:1783947563.340094:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6608380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+41:2353:x1870604297864832:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947563.340110:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947563.340117:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2129 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab058 expref: 41 pid: 5797 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.340130:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2129 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab058 expref: 41 pid: 5797 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.340165:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2129 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab058 expref: 41 pid: 5797 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.340182:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:3.0:1783947563.340188:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2153 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.340198:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.340207:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2153 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.340237:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947563.340319:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6608380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+40:2353:x1870604297864832:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 226us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947563.340328:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00010000:00010000:0.0:1783947563.342987:0:6613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343006:0:6613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343011:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947563.343056:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783947563.343061:0:6613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783947563.343103:0:6613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343119:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343128:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2145 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343135:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2145 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343168:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2145 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343175:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670c00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947563.343179:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2145 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343186:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2145 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343200:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:0.0:1783947563.343203:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947563.343206:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2145 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343282:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2145 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343300:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb214c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343646:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb214c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343652:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb214c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343658:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947563.343661:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb214c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343689:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb214c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343700:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b3c8281b200) 00010000:00010000:0.0:1783947563.343702:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947563.343705:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb214c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343711:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb214c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343757:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb213e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab05f expref: 40 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343771:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab05f expref: 39 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.343778:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:0.0:1783947563.343780:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947563.343783:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670000, rc 0) 00000100:00100000:0.0:1783947563.343855:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb660a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+39:10358:x1870604297864448:12345-192.168.203.32@tcp:101:stat.0 Request processed in 17536us (17728us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947563.343864:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:2.0:1783947563.439191:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947563.439274:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297865088 00000100:00100000:3.0:1783947563.439286:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297865088 00000100:00100000:3.0:1783947563.439549:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:3.0:1783947563.439560:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+39:10364:x1870604297865088:12345-192.168.203.32@tcp:36:truncate.0 00010000:00010000:3.0:1783947563.439619:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947563.439644:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2153 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab05f expref: 39 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.439666:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:3.0:1783947563.439672:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947563.439971:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb215a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.439986:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb215a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.439997:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb215a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783947563.440052:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1783947563.440077:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000158de872 reply state 000000009bf6eb0b transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb215a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947563.440087:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783947563.440264:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+41:10364:x1870604297865088:12345-192.168.203.32@tcp:36:truncate.0 Request processed in 704us (1082us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1783947563.440272:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 54 00000020:00080000:3.0:1783947563.440300:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783947563.443545:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb215a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.443564:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb215a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.443571:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb215a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.443578:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1ba00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947563.443583:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb215a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.443591:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb215a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.443607:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:1.0:1783947563.443610:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947563.443615:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb215a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.443639:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb215a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947563.613265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947563.615257:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297865216 00000100:00100000:3.0:1783947563.615271:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297865216 00000100:00100000:3.0:1783947563.615337:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:3.0:1783947563.615347:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+40:10378:x1870604297865216:12345-192.168.203.32@tcp:101:stat.0 00010000:00010000:3.0:1783947563.615626:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947563.615764:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb2161 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab066 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.615845:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2168 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.615860:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2168 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.615871:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2168 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.615886:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb216f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.615894:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb216f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.615900:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb216f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.616242:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2176 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.616252:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.616273:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947563.616309:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1783947563.616313:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947563.616337:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.616350:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.616358:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2168 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.616365:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2168 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.616987:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2168 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.616994:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947563.616998:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2168 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.617007:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2168 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.617019:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:3.0:1783947563.617022:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947563.617027:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2168 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.617047:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2168 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.617060:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb216f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.617066:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb216f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.617072:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb216f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.617077:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1ae00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947563.617080:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb216f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.617086:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb216f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.617094:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b3c84af9b00) 00010000:00010000:3.0:1783947563.617096:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947563.617098:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb216f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.617105:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb216f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.617144:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb2161 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab066 expref: 42 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.617170:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2176 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab066 expref: 41 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.617184:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:3.0:1783947563.617186:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947563.617189:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a400, rc 0) 00000100:00100000:3.0:1783947563.617296:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+41:10378:x1870604297865216:12345-192.168.203.32@tcp:101:stat.0 Request processed in 1949us (4039us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947563.617305:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 55 00000001:00080000:2.0:1783947563.638296:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000001:00080000:2.0:1783947563.638333:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967336 is committed 00000001:00080000:2.0:1783947563.638368:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967338 is committed 00000004:00080000:2.0:1783947563.638384:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1783947563.638407:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b3ca02af0c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1783947563.638413:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b3ca092bb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b3ca02afa80 00000020:00080000:2.0:1783947563.638445:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b3ca092bf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b3ca0eb0c00 00000020:00080000:1.0:1783947563.638587:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1783947563.638710:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1783947563.638977:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319915776:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783947563.639040:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947563.639375:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319915776 00000100:00100000:0.0:1783947563.639384:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319915776 00000100:00100000:0.0:1783947563.639505:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783947563.639516:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1870604319915776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783947563.639543:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1783947563.639669:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a54e129, atime: 0x6a54e129, ctime: 0x6a54e129, blocks: 0x1 00010000:00010000:0.0:1783947563.639677:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef098f32/0x20c3e53e78bb217d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.639693:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=378s v=(0 0) 00010000:00010000:0.0:1783947563.639698:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947563.639703:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef098f32/0x20c3e53e78bb217d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.639719:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef098f32/0x20c3e53e78bb217d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.639730:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef098f32/0x20c3e53e78bb217d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.639739:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef098f32/0x20c3e53e78bb217d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.639804:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783947563.640336:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1870604319915776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 820us (1294us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1783947563.640345:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:2.0:1783947563.640436:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b3cbd03b100/2, rc 0, transno 4294967301 00000100:00100000:2.0:1783947563.640443:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319915776:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783947563.640665:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947563.640672:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef098f32/0x20c3e53e78bb217d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.640681:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670800 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947563.640685:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef098f32/0x20c3e53e78bb217d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.640694:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef098f32/0x20c3e53e78bb217d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.640711:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef098f32/0x20c3e53e78bb217d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.640719:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef098f32/0x20c3e53e78bb217d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.640743:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947563.640745:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947563.640753:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947563.716360:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947563.716591:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297865472 00000100:00100000:0.0:1783947563.716602:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297865472 00000100:00100000:0.0:1783947563.716718:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00100000:0.0:1783947563.716731:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb660b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+11:10388:x1870604297865472:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1783947563.716753:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947563.716789:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2184 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab06d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947563.717090:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1783947563.717322:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2184 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab06d expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.717338:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84af9a00) 00010000:00010000:0.0:1783947563.717341:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783947563.717347:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2184 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab06d expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.717363:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670400, rc 0) 00000100:00100000:0.0:1783947563.717471:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb660b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+12:10388:x1870604297865472:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 743us (1121us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1783947563.717488:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00100000:1.0:1783947563.722779:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947563.722892:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297865728 00000100:00100000:3.0:1783947563.722902:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297865728 00000100:00100000:3.0:1783947563.722965:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:3.0:1783947563.722976:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+12:10388:x1870604297865728:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1783947563.724141:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:10388:x1870604297865728:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 1159us (1471us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1783947563.724164:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:2.0:1783947563.795550:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947563.796400:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297865984 00000100:00100000:0.0:1783947563.796413:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297865984 00000100:00100000:0.0:1783947563.796575:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:0.0:1783947563.796587:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:10394:x1870604297865984:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1783947563.796613:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947563.796634:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2192 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab074 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.796814:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2199 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.796831:0:6613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2176 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab066 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.796852:0:6613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2199 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.796960:0:6613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2176 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab066 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.796976:0:6613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2176 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab066 expref: 14 pid: 5797 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947563.796991:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6613:1870604319915904:192.168.203.32@tcp:104: 00000100:00100000:0.0:1783947563.798770:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cbd501b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783947563.806648:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947563.806839:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297866112 00000100:00100000:3.0:1783947563.806850:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297866112 00010000:00010000:3.0:1783947563.806903:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2176 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab066 expref: 15 pid: 5797 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947563.806944:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:3.0:1783947563.806955:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb660b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+15:2354:x1870604297866112:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947563.806971:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947563.806978:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2176 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab066 expref: 15 pid: 5797 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.806992:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2176 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab066 expref: 15 pid: 5797 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.807017:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:3.0:1783947563.807024:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2199 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.807035:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2199 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.807061:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2199 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.807080:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947563.807145:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb660b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+15:2354:x1870604297866112:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 191us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947563.807166:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 40 00010000:00010000:0.0:1783947563.811667:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2176 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab066 expref: 14 pid: 5797 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947563.811984:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6613:1870604319915904:192.168.203.32@tcp:104: 00010000:00010000:0.0:1783947563.812011:0:6613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2199 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.812020:0:6613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2199 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.812026:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2199 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947563.812047:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1783947563.812213:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2192 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab074 expref: 15 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.812254:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2199 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab074 expref: 14 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.812262:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:0.0:1783947563.812266:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783947563.812269:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670c00, rc 0) 00000100:00100000:0.0:1783947563.816373:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:10394:x1870604297865984:12345-192.168.203.32@tcp:101:bash.0 Request processed in 19776us (20821us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1783947563.816387:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:2.0:1783947563.819976:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947563.820065:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297866368 00000100:00100000:0.0:1783947563.820075:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297866368 00000100:00100000:0.0:1783947563.820156:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 58 00000100:00100000:0.0:1783947563.820168:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb660a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:10394:x1870604297866368:12345-192.168.203.32@tcp:36:bash.0 00010000:00010000:0.0:1783947563.820481:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb21a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.820500:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb21a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.820510:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb21a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783947563.820556:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1783947563.820577:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003445fbab reply state 00000000a394dcdc transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb21a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947563.820586:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783947563.820696:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb660a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+17:10394:x1870604297866368:12345-192.168.203.32@tcp:36:bash.0 Request processed in 530us (729us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1783947563.820702:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 58 00000020:00080000:0.0:1783947563.820707:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783947563.826295:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb21a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.826311:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb21a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.826319:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb21a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.826325:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947563.826330:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb21a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.826337:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb21a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.826352:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:3.0:1783947563.826355:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947563.826359:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb21a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.826364:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb21a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947563.834574:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947563.834966:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297866496 00000100:00100000:3.0:1783947563.834976:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297866496 00000100:00100000:3.0:1783947563.835036:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:3.0:1783947563.835046:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb660bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+16:10394:x1870604297866496:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1783947563.835072:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947563.835093:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb21ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab07b expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.835234:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb21b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.835250:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2199 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab074 expref: 17 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.835258:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb21b5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.835297:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2199 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab074 expref: 17 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.835311:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2199 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab074 expref: 17 pid: 6613 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947563.835324:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6703480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1870604319916032:192.168.203.32@tcp:104: 00000100:00100000:2.0:1783947563.835938:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3ca02af180 going to sleep for 11 seconds 00000100:00100000:2.0:1783947563.841329:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947563.843989:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297866624 00000100:00100000:3.0:1783947563.844006:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297866624 00010000:00010000:3.0:1783947563.844051:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2199 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab074 expref: 18 pid: 6613 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947563.844121:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:3.0:1783947563.844130:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb660aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:2354:x1870604297866624:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947563.844155:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947563.844163:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2199 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab074 expref: 18 pid: 6613 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.844175:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2199 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab074 expref: 18 pid: 6613 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.844200:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:3.0:1783947563.844207:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb21b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.844217:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb21b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.844225:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb21b5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.844247:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947563.844265:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2199 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab074 expref: 18 pid: 6613 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947563.844286:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6703480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1870604319916032:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947563.844307:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb21b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.844317:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb21b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947563.844320:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb660aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+17:2354:x1870604297866624:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 187us (2999us total) trans 0 rc 0/0 00010000:00010000:1.0:1783947563.844327:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb21b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947563.844334:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 41 00000004:00200000:1.0:1783947563.844378:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783947563.844382:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783947563.844402:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb21b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.845645:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb21ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab07b expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.845669:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb21b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab07b expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.845697:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:1.0:1783947563.845700:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947563.845703:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1ae00, rc 0) 00000100:00100000:1.0:1783947563.846971:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb660bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+16:10394:x1870604297866496:12345-192.168.203.32@tcp:101:bash.0 Request processed in 11916us (12396us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947563.846984:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:2.0:1783947563.857275:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947563.857651:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297866880 00000100:00100000:0.0:1783947563.857664:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297866880 00000100:00100000:0.0:1783947563.857727:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:0.0:1783947563.857738:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85b9a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+16:10394:x1870604297866880:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:0.0:1783947563.857983:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85b9a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+17:10394:x1870604297866880:12345-192.168.203.32@tcp:35:bash.0 Request processed in 246us (716us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1783947563.857992:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:2.0:1783947563.971167:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947563.971269:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297867136 00000100:00100000:0.0:1783947563.971279:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297867136 00000100:00100000:0.0:1783947563.971349:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:0.0:1783947563.971359:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb660ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+17:10404:x1870604297867136:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1783947563.971384:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947563.971404:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb21bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab082 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947563.971881:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1783947563.972052:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb21bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab082 expref: 19 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.972067:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84af9a00) 00010000:00010000:0.0:1783947563.972070:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783947563.972075:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb21bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab082 expref: 19 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.972102:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670e00, rc 0) 00000100:00100000:0.0:1783947563.972174:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb660ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:10404:x1870604297867136:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 816us (1028us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1783947563.972182:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:2.0:1783947563.975622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947563.975863:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297867264 00000100:00100000:0.0:1783947563.975876:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297867264 00000100:00100000:0.0:1783947563.975941:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:0.0:1783947563.975950:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:10404:x1870604297867264:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:0.0:1783947563.976033:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.976051:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.976063:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.976078:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.976085:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.976091:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.976830:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb21d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.976854:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb21d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.976863:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb21d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947563.976909:0:6613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb21d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.976921:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.976928:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.976934:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.976941:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947563.976944:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.976952:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.976963:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:0.0:1783947563.976966:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947563.976971:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.976977:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.976999:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.977005:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.977010:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.977015:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947563.977018:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.977024:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.977032:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b3c8281be00) 00010000:00010000:0.0:1783947563.977034:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947563.977038:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.977043:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.977058:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb21d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.977064:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb21d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.977070:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb21d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.977082:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671c00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947563.977085:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb21d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.977090:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb21d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.977098:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:0.0:1783947563.977100:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947563.977103:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb21d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947563.977109:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb21d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947563.977203:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:10404:x1870604297867264:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 1251us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947563.977213:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:2.0:1783947563.980966:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947563.981189:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297867520 00000100:00100000:0.0:1783947563.981199:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297867520 00000100:00100000:0.0:1783947563.981295:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:0.0:1783947563.981313:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb660b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:10404:x1870604297867520:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:0.0:1783947563.981806:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb660b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:10404:x1870604297867520:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 500us (846us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1783947563.981814:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:2.0:1783947564.024986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947564.027964:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297867776 00000100:00100000:0.0:1783947564.027976:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297867776 00000100:00100000:0.0:1783947564.028056:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:0.0:1783947564.028085:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:10407:x1870604297867776:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1783947564.028110:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947564.028131:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb21df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab089 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.028216:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.028232:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.028243:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.028257:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.028264:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.028271:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.028671:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb21f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.028681:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb21f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.028688:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb21f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947564.028711:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783947564.028850:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.028858:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.028864:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.028869:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947564.028873:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.028880:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.028891:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:1.0:1783947564.028893:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947564.028897:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.028903:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb21e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.028928:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.028935:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.028941:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.028947:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947564.028949:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.028955:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.028963:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b3c8281be00) 00010000:00010000:1.0:1783947564.028965:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947564.028968:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.028974:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb21ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.029028:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb21df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab089 expref: 22 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.029044:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb21f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab089 expref: 21 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.029063:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:1.0:1783947564.029065:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947564.029068:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670e00, rc 0) 00000100:00100000:1.0:1783947564.029143:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:10407:x1870604297867776:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1062us (4166us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1783947564.029159:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:2.0:1783947564.034906:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947564.035056:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947564.035161:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297868032 00000100:00100000:1.0:1783947564.035172:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297868032 00000100:00100000:1.0:1783947564.035244:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:1.0:1783947564.035255:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:10407:x1870604297868032:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:1.0:1783947564.035329:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2202 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.035349:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.035360:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.035398:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.035406:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2202 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.035412:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2202 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.035439:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947564.035456:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2202 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.035465:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2202 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.035477:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:1.0:1783947564.035480:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947564.035485:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2202 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.035491:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2202 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947564.035796:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:10407:x1870604297868032:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 542us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947564.035805:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:3.0:1783947564.036828:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297867904 00000100:00100000:3.0:1783947564.036841:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297867904 00000100:00100000:3.0:1783947564.036929:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:3.0:1783947564.036938:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6608e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:2353:x1870604297867904:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947564.037027:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947564.037048:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb21f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab089 expref: 21 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.037065:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:3.0:1783947564.037070:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947564.037162:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6608e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+20:2353:x1870604297867904:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 225us (2266us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947564.037170:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:2.0:1783947564.039405:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947564.039623:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297868288 00000100:00100000:3.0:1783947564.039634:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297868288 00000100:00100000:3.0:1783947564.039690:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:3.0:1783947564.039700:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+20:10407:x1870604297868288:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1783947564.040104:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:10407:x1870604297868288:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 404us (705us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1783947564.040112:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:3.0:1783947564.090031:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947564.090059:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c879ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319916160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947564.090279:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947564.091517:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c879e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319916672:0@lo:400:kworker.0 00000100:00100000:2.0:1783947564.091580:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947564.091611:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947564.091617:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c879e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319916544:0@lo:400:kworker.0 00000100:00100000:2.0:1783947564.091641:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947564.091838:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c879e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319916288:0@lo:400:kworker.0 00000100:00100000:1.0:1783947564.091875:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947564.091907:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c879e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319916800:0@lo:400:kworker.0 00000100:00100000:1.0:1783947564.091932:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947564.091959:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947564.091964:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c879e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319916416:0@lo:400:kworker.0 00000100:00100000:1.0:1783947564.091985:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947564.092012:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319916672 00000100:00100000:1.0:1783947564.092020:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319916672 00000100:00100000:1.0:1783947564.092071:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319916544 00000100:00100000:1.0:1783947564.092075:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319916544 00000100:00100000:1.0:1783947564.092090:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319916416 00000100:00100000:1.0:1783947564.092092:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319916416 00000100:00100000:1.0:1783947564.092126:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783947564.092143:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319916672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947564.092218:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319916672:12345-0@lo:400:kworker.0 Request processed in 66us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947564.092226:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783947564.092244:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783947564.092250:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319916544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947564.092277:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319916544:12345-0@lo:400:kworker.0 Request processed in 27us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947564.092283:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783947564.092293:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783947564.092299:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319916416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947564.092327:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319916416:12345-0@lo:400:kworker.0 Request processed in 28us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947564.092333:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1783947564.092349:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947564.092381:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c879e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319916544:0@lo:400:kworker.0 00000100:00100000:1.0:1783947564.092392:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c879e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319916672:0@lo:400:kworker.0 00000100:00100000:1.0:1783947564.092459:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c879e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319916416:0@lo:400:kworker.0 00000100:00100000:2.0:1783947564.093178:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319916288 00000100:00100000:2.0:1783947564.093186:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319916288 00000100:00100000:2.0:1783947564.093344:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1783947564.093352:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c867fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3311:x1870604319916288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947564.093407:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c867fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3311:x1870604319916288:12345-0@lo:400:kworker.0 Request processed in 55us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947564.093413:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1783947564.093731:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c879e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319916288:0@lo:400:kworker.0 00000100:00100000:3.0:1783947564.093822:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319916800 00000100:00100000:3.0:1783947564.093828:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319916800 00000100:00100000:3.0:1783947564.093875:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783947564.093883:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319916800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947564.093928:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319916800:12345-0@lo:400:kworker.0 Request processed in 47us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947564.093934:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783947564.093984:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c879e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319916800:0@lo:400:kworker.0 00000100:00080000:1.0:1783947564.094677:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783947564.099292:0:11568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319916160 00000100:00100000:0.0:1783947564.099308:0:11568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319916160 00000100:00080000:1.0:1783947564.100271:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947564.100659:0:11568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783947564.100678:0:11568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1870604319916160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947564.100716:0:11568:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947564.100809:0:11568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1870604319916160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (10531us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947564.100817:0:11568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783947564.100905:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c879ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319916160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947564.237789:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947564.238112:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297868544 00000100:00100000:1.0:1783947564.238122:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297868544 00000100:00100000:1.0:1783947564.238199:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00100000:1.0:1783947564.238209:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:10425:x1870604297868544:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:1.0:1783947564.238250:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947564.238272:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2209 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab090 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.238868:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2210 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.238886:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2210 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.238898:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2210 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947564.238911:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783947564.239124:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2209 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab090 expref: 24 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.239153:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2210 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab090 expref: 23 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.239163:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:1.0:1783947564.239166:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783947564.239169:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a200, rc 0) 00000100:00100000:1.0:1783947564.239239:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:10425:x1870604297868544:12345-192.168.203.32@tcp:101:cat.0 Request processed in 1031us (1460us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1783947564.239248:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00100000:2.0:1783947564.286297:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947564.287082:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297868672 00000100:00100000:1.0:1783947564.287094:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297868672 00000100:00100000:1.0:1783947564.287174:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:1.0:1783947564.287200:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:10426:x1870604297868672:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1783947564.287226:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947564.287249:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb221e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab097 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.287320:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2225 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.287335:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.287346:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947564.287580:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1783947564.287584:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783947564.287669:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.287699:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb221e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab097 expref: 25 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.287718:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2225 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab097 expref: 24 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.287728:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:1.0:1783947564.287731:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947564.287735:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73ae00, rc 0) 00000100:00100000:1.0:1783947564.287846:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:10426:x1870604297868672:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 648us (1562us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947564.287863:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:0.0:1783947564.300284:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947564.303082:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297869056 00000100:00100000:3.0:1783947564.303100:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297869056 00000100:00100000:3.0:1783947564.303255:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:3.0:1783947564.303268:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:10426:x1870604297869056:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1783947564.304539:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+25:10426:x1870604297869056:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 1268us (4260us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1783947564.304551:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:2.0:1783947564.308895:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947564.312543:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297869184 00000100:00100000:3.0:1783947564.312557:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297869184 00000100:00100000:3.0:1783947564.312639:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:3.0:1783947564.312650:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+25:10426:x1870604297869184:12345-192.168.203.32@tcp:103:lfs.0 00010000:00010000:3.0:1783947564.312677:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783947564.312701:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb21b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab07b expref: 25 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.312724:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2210 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab090 expref: 24 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.312739:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb20b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab03c expref: 23 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.312750:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6c00) 00010000:00010000:3.0:1783947564.312762:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947564.312817:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+22:10426:x1870604297869184:12345-192.168.203.32@tcp:103:lfs.0 Request processed in 169us (3933us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947564.312836:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:2.0:1783947564.318247:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947564.318348:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297869312 00000100:00100000:0.0:1783947564.318359:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297869312 00000100:00100000:0.0:1783947564.318506:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 66 00000100:00100000:0.0:1783947564.318518:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+22:10426:x1870604297869312:12345-192.168.203.32@tcp:58:lfs.0 00010000:00010000:0.0:1783947564.320469:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb222c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.320491:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb222c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.320504:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb222c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783947564.323111:0:6613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947564.323339:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1783947564.325928:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1783947564.326228:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+22:10426:x1870604297869312:12345-192.168.203.32@tcp:58:lfs.0 Request processed in 7707us (7983us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947564.326256:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 66 00010000:00010000:0.0:1783947564.345696:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947564.374524:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947564.374645:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297869440 00000100:00100000:1.0:1783947564.374653:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297869440 00000100:00100000:1.0:1783947564.374697:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 67 00000100:00100000:1.0:1783947564.374704:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+22:10428:x1870604297869440:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1783947564.374722:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947564.374741:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2233 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab09e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.374813:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb223a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.374828:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb223a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.374841:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb223a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.374858:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2241 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.374863:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.374867:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375116:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2248 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375136:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375157:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947564.375191:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783947564.375194:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783947564.375207:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375216:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375221:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb223a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375225:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb223a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375229:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb223a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375233:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947564.375236:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb223a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375240:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb223a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375249:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:1.0:1783947564.375251:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947564.375268:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb223a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375273:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb223a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375281:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375285:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2241 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375288:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2241 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375291:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947564.375293:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2241 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375296:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2241 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375300:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b3c82977a00) 00010000:00010000:1.0:1783947564.375302:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947564.375303:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2241 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375306:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2241 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375330:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2233 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab09e expref: 24 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375357:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2248 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab09e expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.375362:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c8281b000) 00010000:00010000:1.0:1783947564.375363:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947564.375365:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73bc00, rc 0) 00000100:00100000:1.0:1783947564.375465:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:10428:x1870604297869440:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 762us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947564.375470:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 67 00000100:00100000:2.0:1783947564.601854:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783947564.601878:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319916928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947564.601956:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947564.602068:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319916928 00000100:00100000:1.0:1783947564.602078:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319916928 00000100:00100000:1.0:1783947564.602131:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783947564.602149:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319916928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947564.602186:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783947564.602237:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319916928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947564.602245:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783947564.602508:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319916928:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1783947564.673344:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783947564.673353:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783947564.673399:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783947564.673406:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783947564.673671:0:11551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83370000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870604319917056:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783947564.673809:0:11551:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cbd501d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947564.681258:0:11551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83370000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870604319917056:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783947564.681616:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947564.681706:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297869568 00000100:00100000:1.0:1783947564.681715:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297869568 00000100:00100000:1.0:1783947564.681780:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:1.0:1783947564.681790:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:10439:x1870604297869568:12345-192.168.203.32@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1783947564.681871:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:10439:x1870604297869568:12345-192.168.203.32@tcp:900:lhsmtool_posix.0 Request processed in 82us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947564.681880:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:0.0:1783947564.687398:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947564.687594:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297869696 00000100:00100000:1.0:1783947564.687616:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297869696 00000100:00100000:1.0:1783947564.687675:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:1.0:1783947564.687685:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:10439:x1870604297869696:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783947564.687731:0:5797:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783947564.687861:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:10439:x1870604297869696:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 177us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947564.687869:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:3.0:1783947564.703182:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947564.703334:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297869824 00000100:00100000:0.0:1783947564.703344:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297869824 00000100:00100000:0.0:1783947564.703407:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:0.0:1783947564.703454:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:10439:x1870604297869824:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783947564.703527:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb224f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703545:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb224f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703557:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb224f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703573:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2256 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703579:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2256 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703601:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2256 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703630:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb225d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703642:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb225d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703650:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb225d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947564.703687:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783947564.703691:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783947564.703707:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb225d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703719:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb224f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703725:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb224f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703731:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb224f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703736:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671e00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947564.703740:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb224f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703747:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb224f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703766:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b3c84bc6300) 00010000:00010000:0.0:1783947564.703769:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947564.703774:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb224f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703781:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb224f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703809:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2256 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703815:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2256 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703821:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2256 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703826:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670e00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947564.703829:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2256 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703836:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2256 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703844:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8b3c8281bb00) 00010000:00010000:0.0:1783947564.703846:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947564.703849:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2256 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703855:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2256 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703881:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb225d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703888:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb225d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703894:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb225d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703899:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671c00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947564.703902:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb225d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703907:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb225d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703914:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c8281b000) 00010000:00010000:0.0:1783947564.703916:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947564.703919:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb225d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947564.703924:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb225d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947564.703988:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:10439:x1870604297869824:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 Request processed in 572us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947564.703996:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:2.0:1783947564.712260:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947564.712394:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297870080 00000100:00100000:1.0:1783947564.712404:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297870080 00000100:00100000:1.0:1783947564.712515:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 70 00000100:00100000:1.0:1783947564.712529:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:10439:x1870604297870080:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947564.712552:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947564.712579:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2264 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab0a5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.712709:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb226b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.712728:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb226b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.712742:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb226b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947564.712753:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783947564.712880:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb226b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.712891:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb226b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.712916:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb226b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.712924:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947564.712928:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb226b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.712935:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb226b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.712964:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c8281b000) 00010000:00010000:1.0:1783947564.712968:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947564.712973:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb226b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.712983:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb226b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.713037:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2264 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0a5 expref: 25 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.713048:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b3c84bc6300) 00010000:00010000:1.0:1783947564.713055:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947564.713059:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2264 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0a5 expref: 25 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.713073:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a800, rc 0) 00000100:00100000:1.0:1783947564.713159:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:10439:x1870604297870080:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 620us (894us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1783947564.713177:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 70 00000100:00100000:0.0:1783947564.723992:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947564.724159:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297870208 00000100:00100000:3.0:1783947564.724170:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297870208 00000100:00100000:3.0:1783947564.724235:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 71 00000100:00100000:3.0:1783947564.724255:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:10439:x1870604297870208:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783947564.724465:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783947564.724575:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:10439:x1870604297870208:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 330us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947564.724582:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 71 00000100:00100000:1.0:1783947564.734305:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947564.734591:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297870464 00000100:00100000:3.0:1783947564.734602:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297870464 00000100:00100000:3.0:1783947564.734659:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 72 00000100:00100000:3.0:1783947564.734669:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:10439:x1870604297870464:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947564.734690:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947564.734693:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783947564.734720:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2225 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab097 expref: 24 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.734739:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:3.0:1783947564.734744:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947564.734756:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb2279 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab0ac expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783947564.735968:0:5797:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1783947564.736954:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2280 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.736980:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.736992:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.737064:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb2279 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0ac expref: 26 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.737082:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2280 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0ac expref: 25 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.737090:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b3c84af9b00) 00010000:00010000:3.0:1783947564.737093:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947564.737096:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a600, rc 0) 00000100:00100000:3.0:1783947564.737221:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+25:10439:x1870604297870464:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 2553us (2939us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1783947564.737231:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 72 00000100:00100000:2.0:1783947564.742108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947564.742204:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297870720 00000100:00100000:3.0:1783947564.742213:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297870720 00000100:00100000:3.0:1783947564.742716:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00100000:3.0:1783947564.742728:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+25:10439:x1870604297870720:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783947564.742789:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947564.742826:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2280 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0ac expref: 25 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.742844:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b3c84af9b00) 00010000:00010000:3.0:1783947564.742863:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947564.742887:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb228e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.742901:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb228e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.742911:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb228e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.742964:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb2295 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe01fdaa9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.742972:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb2295 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe01fdaa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.742979:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb2295 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe01fdaa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.743782:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb228e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.743868:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb228e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.743877:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb228e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.743884:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947564.743888:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb228e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.743897:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb228e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.743914:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:3.0:1783947564.743917:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947564.743921:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb228e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.743928:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb228e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.743940:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb2295 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe01fdaa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.743947:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb2295 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe01fdaa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.743953:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb2295 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe01fdaa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.743960:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1aa00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947564.743962:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb2295 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe01fdaa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.743969:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb2295 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe01fdaa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.743976:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe01fdaa9 (ffff8b3c84af9900) 00010000:00010000:3.0:1783947564.743979:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947564.743982:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb2295 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe01fdaa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.743987:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb2295 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe01fdaa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947564.744135:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:10439:x1870604297870720:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 1407us (2032us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783947564.744152:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00100000:1.0:1783947564.747290:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947564.747373:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297870848 00000100:00100000:2.0:1783947564.747383:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297870848 00000100:00100000:2.0:1783947564.747474:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00100000:2.0:1783947564.747484:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:10439:x1870604297870848:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947564.747504:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947564.747526:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb229c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab0b3 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947564.747563:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb22a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947564.747586:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb22a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947564.747596:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb22a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947564.747698:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb229c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0b3 expref: 26 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947564.747713:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb22a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0b3 expref: 25 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947564.747721:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b3c84bc6a00) 00010000:00010000:2.0:1783947564.747724:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783947564.747727:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630c00, rc 0) 00000100:00100000:2.0:1783947564.747786:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+25:10439:x1870604297870848:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 303us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947564.747805:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00100000:1.0:1783947564.751720:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947564.754558:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297871104 00000100:00100000:2.0:1783947564.754645:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297871104 00000100:00100000:2.0:1783947564.754713:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 75 00000100:00100000:2.0:1783947564.754724:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+25:10439:x1870604297871104:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783947564.754805:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb22aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947564.754988:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb22aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947564.755024:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb22aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947564.755527:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1783947564.755537:0:5798:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 380026118786ns, next at 381026116497ns, rc = 0 00000004:00010000:2.0:1783947564.755761:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c3138c58 reply state 0000000073120f1f transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb22aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947564.755772:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783947564.755892:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+27:10439:x1870604297871104:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 1168us (4178us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1783947564.755901:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 75 00010000:00010000:1.0:1783947564.764453:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb22aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.764471:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb22aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947564.764477:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:1.0:1783947564.764483:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb22aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.764490:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631a00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947564.764496:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb22aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.764506:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb22aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.764524:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b3c84bc6a00) 00010000:00010000:1.0:1783947564.764528:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783947564.764532:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb22aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.764538:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb22aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947564.765780:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297871232 00000100:00100000:3.0:1783947564.765793:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297871232 00000100:00100000:3.0:1783947564.765843:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 76 00000100:00100000:3.0:1783947564.765853:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+26:10439:x1870604297871232:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947564.765878:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947564.765898:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb22b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab0ba expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.765954:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb22b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0ba expref: 27 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.765969:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb22b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0ba expref: 27 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.765987:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b3c84bc6a00) 00010000:00010000:3.0:1783947564.765991:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783947564.765994:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1aa00, rc 0) 00000100:00100000:3.0:1783947564.766056:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+27:10439:x1870604297871232:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 204us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947564.766063:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 76 00000100:00100000:2.0:1783947564.772918:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947564.773091:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297871360 00000100:00100000:1.0:1783947564.773102:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297871360 00000100:00100000:1.0:1783947564.773165:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:1.0:1783947564.773174:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1870604297871360:12345-192.168.203.32@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1783947564.773209:0:6592:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp t0 exp 0000000000000000 cur 380 last 0 00000020:00000080:1.0:1783947564.773244:0:6592:0:(genops.c:1406:class_connect()) connect: client d1ed966c-3190-4795-821d-ae5dca7b5f51, cookie 0x20c3e53e78bb22b8 00002000:00100000:1.0:1783947564.773256:0:6592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d1ed966c-3190-4795-821d-ae5dca7b5f51/ffff8b3c84db7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783947564.773267:0:6592:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783947564.773718:0:6592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783947564.773752:0:6592:0:(import.c:65:import_set_state_nolock()) ffff8b3c84db3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783947564.773873:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2352:x1870604297871360:12345-192.168.203.32@tcp:8:lhsmtool_posix.0 Request processed in 698us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947564.773882:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:0.0:1783947564.776820:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947564.776955:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297871488 00000100:00100000:3.0:1783947564.776967:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297871488 00000100:00100000:3.0:1783947564.777049:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:3.0:1783947564.777066:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:0:x1870604297871488:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1783947564.777548:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1783947564.844205:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d1ed966c-3190-4795-821d-ae5dca7b5f51 00000001:00080000:0.0:1783947564.844245:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1783947564.847945:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:0:x1870604297871488:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 70872us (71126us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783947564.847958:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:2.0:1783947564.854609:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947564.854871:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297871744 00000100:00100000:3.0:1783947564.854882:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297871744 00000100:00100000:3.0:1783947564.854932:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:3.0:1783947564.854944:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+27:10439:x1870604297871744:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783947564.855199:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+28:10439:x1870604297871744:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 256us (599us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1783947564.855207:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:3.0:1783947564.858063:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947564.858101:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297872000 00000100:00100000:3.0:1783947564.858111:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297872000 00000100:00100000:3.0:1783947564.858180:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 77 00000100:00100000:3.0:1783947564.858190:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+28:10439:x1870604297872000:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783947564.858316:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+28:10439:x1870604297872000:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 127us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947564.858325:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 77 00000100:00100000:2.0:1783947564.865489:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947564.865758:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297872128 00000100:00100000:3.0:1783947564.865770:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297872128 00000100:00100000:3.0:1783947564.865831:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 78 00000100:00100000:3.0:1783947564.865840:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+28:10439:x1870604297872128:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947564.865861:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947564.865882:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb22bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab0c1 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.865955:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb22c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.865970:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb22c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.865981:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb22c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947564.866016:0:6613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947564.866034:0:6613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb22c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.866060:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb22bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0c1 expref: 30 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.866075:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb22c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0c1 expref: 29 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.866083:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b3c84bc6a00) 00010000:00010000:3.0:1783947564.866086:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783947564.866090:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a600, rc 0) 00000100:00100000:3.0:1783947564.866170:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+29:10439:x1870604297872128:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 331us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947564.866178:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 78 00000100:00100000:2.0:1783947564.871342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947564.871535:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297872256 00000100:00100000:3.0:1783947564.871545:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297872256 00000100:00100000:3.0:1783947564.871599:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:3.0:1783947564.871614:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297872256:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947564.871632:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947564.871712:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb22cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab0c8 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947564.871740:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54e12c, blocks: 0x1 00010000:00010000:3.0:1783947564.871757:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=380s v=(0 0) 00010000:00010000:3.0:1783947564.871761:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947564.871770:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb22cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0c8 expref: 6 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.871789:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb22cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0c8 expref: 6 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.871802:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1ae00, rc 0) 00000100:00100000:3.0:1783947564.871852:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297872256:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 240us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947564.871859:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:0.0:1783947564.884381:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947564.884469:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297872512 00000100:00100000:2.0:1783947564.884480:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297872512 00000100:00100000:2.0:1783947564.884547:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 79 00000100:00100000:2.0:1783947564.884560:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+29:10439:x1870604297872512:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783947564.884674:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+29:10439:x1870604297872512:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 114us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947564.885254:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 79 00000100:00100000:2.0:1783947564.892019:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947564.892097:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297872640 00000100:00100000:3.0:1783947564.892107:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297872640 00000100:00100000:3.0:1783947564.892205:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:3.0:1783947564.892216:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:10439:x1870604297872640:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947564.892233:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947564.892250:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb22d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab0cf expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.892547:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb22cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0c8 expref: 7 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.892558:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947564.892562:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947564.892568:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb22d4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0cf expref: 7 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.892604:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb22cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0c8 expref: 7 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.892618:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb22cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0c8 expref: 7 pid: 6590 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947564.892634:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6703b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1870604319917184:192.168.203.32@tcp:104: 00000100:00100000:3.0:1783947564.892843:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb6ba0600 going to sleep for 11 seconds 00000100:00100000:2.0:1783947564.897240:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947564.897303:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297872768 00000100:00100000:1.0:1783947564.897313:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297872768 00010000:00010000:1.0:1783947564.897356:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb22cd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0c8 expref: 8 pid: 6590 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947564.897405:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:1.0:1783947564.897415:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c856edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2353:x1870604297872768:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947564.897450:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947564.897474:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb22cd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0c8 expref: 8 pid: 6590 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.897488:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb22cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0c8 expref: 8 pid: 6590 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.897536:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947564.897541:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947564.897550:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb22d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0cf expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.897561:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb22d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0cf expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947564.897598:0:5784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb22d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0cf expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947564.897611:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6585880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5784:1870604319917312:192.168.203.32@tcp:105: 00000100:00100000:1.0:1783947564.897692:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cc01ee6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1783947564.900062:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb22cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0c8 expref: 8 pid: 6590 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947564.900263:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6703b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1870604319917184:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947564.900294:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb22d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0cf expref: 7 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947564.900364:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a000, rc 0) 00000100:00100000:2.0:1783947564.901175:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:10439:x1870604297872640:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 8956us (9159us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947564.901191:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:2.0:1783947564.901561:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6585880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5784:1870604319917312:192.168.203.32@tcp:105: 00010000:00010000:2.0:1783947564.901580:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947564.901618:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c856edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2353:x1870604297872768:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 4205us (4389us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947564.901628:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:3.0:1783947564.908758:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947564.909061:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297872896 00000100:00100000:2.0:1783947564.909084:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297872896 00002000:00100000:2.0:1783947564.909778:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8b3cb6703b80 x1870604297872896/t0(0) o4->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:355/0 lens 504/0 e 0 to 0 dl 1783947575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783947564.909790:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3cb6703b80 with x1870604297872896 ext(0->8) 00002000:00010000:2.0:1783947564.909796:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b3cb6703b80 00000100:00100000:2.0:1783947564.909836:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:2.0:1783947564.909847:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297872896:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783947564.911017:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2354:x1870604297872896:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 Request processed in 1167us (2262us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1783947564.911029:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00002000:00100000:2.0:1783947564.911039:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8b3cb6703b80 x1870604297872896/t4294967302(0) o4->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:355/0 lens 504/448 e 0 to 0 dl 1783947575 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783947564.911048:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3cb6703b80 with x1870604297872896 ext(0->8) 00002000:00010000:2.0:1783947564.911052:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b3cb6703b80 00000100:00100000:3.0:1783947564.916285:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947564.916480:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297873024 00000100:00100000:0.0:1783947564.916489:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297873024 00000100:00100000:0.0:1783947564.916550:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 80 00000100:00100000:0.0:1783947564.916562:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+29:10439:x1870604297873024:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1783947564.962730:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967346 is committed 00000001:00080000:2.0:1783947564.962755:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000020:00080000:2.0:1783947564.962766:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1783947564.962783:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:10439:x1870604297873024:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 Request processed in 46219us (46504us total) trans 0 rc 0/0 00000001:00080000:2.0:1783947564.962791:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000100:00100000:3.0:1783947564.962794:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 80 00000004:00080000:2.0:1783947564.962796:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1783947564.962809:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:2.0:1783947564.962828:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1783947564.962837:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1783947564.962937:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947564.962952:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319917440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1783947564.963003:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947564.963066:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319917440 00000100:00100000:3.0:1783947564.963073:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319917440 00000100:00100000:3.0:1783947564.963114:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783947564.963132:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319917440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1783947564.963290:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783947564.963294:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783947564 00002000:00010000:3.0:1783947564.963296:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783947564.963298:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783947564 -> 1783947564 00002000:00010000:3.0:1783947564.963300:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783947564.964080:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1870604319917440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 952us (1071us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1783947564.964092:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1783947564.964269:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b3cb6700700/2, rc 0, transno 4294967303 00000100:00100000:1.0:1783947564.964278:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319917440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783947564.966392:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947564.966783:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297873152 00000100:00100000:2.0:1783947564.966793:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297873152 00000100:00100000:2.0:1783947564.966855:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:2.0:1783947564.966865:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2353:x1870604297873152:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1783947565.017633:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1783947565.017675:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1783947565.019221:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2353:x1870604297873152:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 Request processed in 52346us (52828us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947565.019237:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:3.0:1783947565.035446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947565.036019:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297873408 00000100:00100000:1.0:1783947565.036030:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297873408 00000100:00100000:1.0:1783947565.037165:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 81 00000100:00100000:1.0:1783947565.037178:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:10439:x1870604297873408:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783947565.037232:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947565.037257:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb22c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0c1 expref: 13 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.037284:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b3c84bc6a00) 00010000:00010000:1.0:1783947565.037289:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947565.037318:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.037330:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.037339:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947565.037603:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006a36c95a reply state 000000009195c563 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947565.037613:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783947565.037710:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:10439:x1870604297873408:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 534us (2296us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1783947565.037717:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 81 00010000:00010000:1.0:1783947565.042599:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.042615:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.042623:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.042630:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947565.042634:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.042651:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.042667:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b3c84bc6a00) 00010000:00010000:1.0:1783947565.042670:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947565.042674:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.042681:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783947565.043675:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947565.045060:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947565.045231:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297873536 00000100:00100000:1.0:1783947565.045242:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297873536 00000100:00100000:1.0:1783947565.045299:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:1.0:1783947565.045310:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297873536:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783947565.046077:0:6590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1783947565.046083:0:6590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1783947564 -> 1783947563 00002000:00010000:1.0:1783947565.046085:0:6590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783947561 00002000:00010000:1.0:1783947565.046087:0:6590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783947564 -> 1783947563 00002000:00010000:1.0:1783947565.046089:0:6590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1783947565.046921:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2354:x1870604297873536:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 1606us (1861us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1783947565.046934:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:3.0:1783947565.055192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947565.055324:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297873792 00000100:00100000:2.0:1783947565.055335:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297873792 00000100:00100000:2.0:1783947565.055456:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 82 00000100:00100000:2.0:1783947565.055475:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:10439:x1870604297873792:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783947565.055543:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb22e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.055560:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb22a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0b3 expref: 13 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.055571:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb22e2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.055605:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb22a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0b3 expref: 13 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.055619:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb22a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0b3 expref: 13 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947565.055643:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c879ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1870604319917568:192.168.203.32@tcp:104: 00000100:00100000:2.0:1783947565.055729:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672900 going to sleep for 11 seconds 00000100:00100000:2.0:1783947565.061254:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c879ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1870604319917568:192.168.203.32@tcp:104: 00010000:00010000:2.0:1783947565.061283:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb22e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947565.061345:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947565.064651:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297873920 00000100:00100000:2.0:1783947565.064667:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297873920 00010000:00010000:3.0:1783947565.066443:0:8318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb22a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0b3 expref: 14 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947565.066511:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:3.0:1783947565.066522:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:2354:x1870604297873920:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947565.066540:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947565.066547:0:8318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb22a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0b3 expref: 14 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.066561:0:8318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb22a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0b3 expref: 14 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.066581:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb22a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0b3 expref: 14 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.066594:0:8318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b3c84bc6a00) 00010000:00010000:3.0:1783947565.066599:0:8318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb22e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.066608:0:8318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb22e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.066615:0:8318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb22e2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.066641:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947565.066698:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:2354:x1870604297873920:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 178us (5576us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947565.066706:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 43 00010000:00010000:3.0:1783947565.066736:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb22e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.066751:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb22e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.066779:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb22e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.066786:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb22e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.066792:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb22e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.066798:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947565.066802:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb22e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.066810:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb22e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.066818:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b3c84bc6a00) 00010000:00010000:3.0:1783947565.066821:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1783947565.066824:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb22e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.066830:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631000/0x20c3e53e78bb22e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947565.066869:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+12:10439:x1870604297873792:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 Request processed in 11404us (11686us total) trans 0 rc -22/-22 00000100:00100000:3.0:1783947565.066877:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 82 00000100:00100000:3.0:1783947565.069414:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947565.069696:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297874048 00000100:00100000:2.0:1783947565.069705:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297874048 00000100:00100000:2.0:1783947565.069761:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:2.0:1783947565.069772:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2353:x1870604297874048:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783947565.069818:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a1869be/0x20c3e53e78bb22e9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.069837:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb22d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0cf expref: 7 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.069846:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947565.069851:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947565.069855:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a1869be/0x20c3e53e78bb22e9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.069969:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb22d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0cf expref: 7 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.069999:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb22d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0cf expref: 7 pid: 6591 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947565.070014:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c879ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1870604319917696:192.168.203.32@tcp:104: 00000100:00100000:2.0:1783947565.070136:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672900 going to sleep for 11 seconds 00000100:00100000:2.0:1783947565.076199:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c879ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1870604319917696:192.168.203.32@tcp:104: 00010000:00010000:2.0:1783947565.076228:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009a1869be/0x20c3e53e78bb22e9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947565.077406:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947565.077656:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297874176 00000100:00100000:2.0:1783947565.077666:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297874176 00010000:00010000:2.0:1783947565.077704:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb22d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0cf expref: 8 pid: 6591 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947565.077749:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:2.0:1783947565.077759:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2354:x1870604297874176:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947565.077774:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947565.077798:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb22d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0cf expref: 8 pid: 6591 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.077812:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb22d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0cf expref: 8 pid: 6591 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.077836:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb22d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0cf expref: 8 pid: 6591 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.077859:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947565.077863:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947565.077870:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a1869be/0x20c3e53e78bb22e9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.077880:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a1869be/0x20c3e53e78bb22e9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.077916:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947565.077968:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2354:x1870604297874176:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 210us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947565.077976:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 44 00010000:00010000:3.0:1783947565.078617:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009a1869be/0x20c3e53e78bb22e9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.078630:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a1869be/0x20c3e53e78bb22e9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.078658:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a1869be/0x20c3e53e78bb22e9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.078665:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a1869be/0x20c3e53e78bb22e9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.078673:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a1869be/0x20c3e53e78bb22e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.078680:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631e00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947565.078684:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a1869be/0x20c3e53e78bb22e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.078692:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a1869be/0x20c3e53e78bb22e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.078706:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a1869be/0x20c3e53e78bb22e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.078730:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a1869be/0x20c3e53e78bb22e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947565.078794:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2353:x1870604297874048:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 Request processed in 9023us (9387us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947565.078803:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:3.0:1783947565.081694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947565.081874:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297874432 00000100:00100000:1.0:1783947565.081884:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297874432 00000100:00100000:1.0:1783947565.081939:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 83 00000100:00100000:1.0:1783947565.081950:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+12:10439:x1870604297874432:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783947565.082031:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb22f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.082047:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb22f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.082058:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb22f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.084101:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.084126:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb22b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0ba expref: 13 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.084135:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22f7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.084183:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb22b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0ba expref: 13 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.084199:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb22b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0ba expref: 13 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947565.084214:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb655f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5795:1870604319917824:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947565.084306:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cc01ee3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947565.099801:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947565.101537:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297874560 00000100:00100000:2.0:1783947565.101548:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297874560 00010000:00010000:2.0:1783947565.101591:0:8318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb22b1 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0ba expref: 14 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947565.101629:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:2.0:1783947565.101639:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:2353:x1870604297874560:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947565.101654:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947565.101661:0:8318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb22b1 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0ba expref: 14 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.101675:0:8318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb22b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0ba expref: 14 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.101704:0:8318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b3c84bc6a00) 00010000:00010000:2.0:1783947565.101710:0:8318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.101718:0:8318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.101724:0:8318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22f7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.101742:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947565.101797:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:2353:x1870604297874560:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 160us (2006us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947565.101805:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 45 00010000:00010000:0.0:1783947565.101918:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb22b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0ba expref: 13 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947565.101934:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb655f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5795:1870604319917824:192.168.203.32@tcp:104: 00010000:00010000:0.0:1783947565.101956:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.101964:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.101970:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783947565.102165:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1783947565.102316:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1783947565.102367:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1783947565.103592:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5795:1870604319917952:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783947565.103657:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947565.103686:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e42d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947565.105724:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319917952 00000100:00100000:3.0:1783947565.105736:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319917952 00000100:00100000:3.0:1783947565.105797:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783947565.105807:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5795:x1870604319917952:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783947565.105914:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5795:x1870604319917952:12345-0@lo:1000:mdt00_000.0 Request processed in 109us (2256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947565.105921:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947565.106540:0:5795:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1783947565.106549:0:5795:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b3cb6700700, transno 4294967303 00000100:00100000:0.0:1783947565.106566:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5795:1870604319917952:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1783947565.106987:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1783947565.107056:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5795:1870604319918080:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783947565.107100:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947565.107819:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319918080 00000100:00100000:1.0:1783947565.107827:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319918080 00000100:00100000:1.0:1783947565.107868:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947565.107875:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5795:x1870604319918080:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783947565.108037:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5795:x1870604319918080:12345-0@lo:1000:mdt00_000.0 Request processed in 161us (935us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1783947565.108044:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947565.109238:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e42c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947565.109279:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5795:1870604319918080:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1783947565.109379:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.109389:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22f7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.109397:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.109403:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947565.109407:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.109437:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22f7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.109454:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b3c84bc6a00) 00010000:00010000:0.0:1783947565.109457:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947565.109461:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22f7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.109534:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb22f7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.109569:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb222c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.109582:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb222c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.109588:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb222c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.109593:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947565.109596:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb222c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.109602:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb222c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.109610:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c8281b000) 00010000:00010000:0.0:1783947565.109613:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947565.109616:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb222c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.109621:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb222c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.109644:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb22fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.109656:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2248 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab09e expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.109665:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb22fe lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.109698:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2248 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab09e expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.109716:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2248 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab09e expref: 16 pid: 5798 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947565.109730:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5795:1870604319918208:192.168.203.32@tcp:104: 00000100:00100000:0.0:1783947565.109799:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e42c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947565.121600:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947565.121904:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297874688 00000100:00100000:1.0:1783947565.121913:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297874688 00010000:00010000:1.0:1783947565.121951:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2248 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab09e expref: 17 pid: 5798 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947565.121993:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:1.0:1783947565.122002:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+17:2354:x1870604297874688:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947565.122016:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947565.122024:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2248 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab09e expref: 17 pid: 5798 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.122037:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2248 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab09e expref: 17 pid: 5798 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.122058:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c8281b000) 00010000:00010000:1.0:1783947565.122063:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb22fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.122072:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb22fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.122080:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb22fe lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.122099:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947565.122177:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+17:2354:x1870604297874688:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 175us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947565.122185:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 46 00010000:00010000:0.0:1783947565.122492:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2248 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab09e expref: 16 pid: 5798 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947565.122508:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5795:1870604319918208:192.168.203.32@tcp:104: 00010000:00010000:0.0:1783947565.122529:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb22fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.122537:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb22fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.122542:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb22fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.122552:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb22fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.122558:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb22fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.122564:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb22fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.122569:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947565.122580:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb22fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.122587:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb22fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.122597:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c8281b000) 00010000:00010000:0.0:1783947565.122599:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947565.122603:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb22fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.122609:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb22fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.122622:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb22f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.122628:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb22f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.122633:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb22f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.122638:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947565.122641:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb22f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.122646:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb22f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.122652:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c8281b000) 00010000:00010000:0.0:1783947565.122654:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783947565.122664:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb22f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.122669:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb22f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947565.122866:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+15:10439:x1870604297874432:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 40917us (41180us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1783947565.122876:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 83 00000020:00080000:0.0:1783947565.122880:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783947565.123110:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947565.123115:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947565.123163:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783947565.123169:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783947565.129973:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947565.131146:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297874944 00000100:00100000:1.0:1783947565.131157:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297874944 00000100:00100000:1.0:1783947565.131217:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:1.0:1783947565.131227:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+15:10439:x1870604297874944:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783947565.131884:0:5799:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783947565.131986:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1783947565.132029:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2305 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.132042:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.132052:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.132061:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2305 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.132067:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2305 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.132073:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2305 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.132092:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783947565.132202:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+17:10439:x1870604297874944:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 974us (2238us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1783947565.132211:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000020:00080000:1.0:1783947565.132222:0:5799:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783947565.132245:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947565.132250:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2305 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.132258:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a600 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947565.132262:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2305 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.132270:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2305 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.132282:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b3c82977a00) 00010000:00010000:1.0:1783947565.132285:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783947565.132289:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2305 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.132295:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2305 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.132310:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947565.132311:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947565.132313:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783947565.164231:0:11869:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783947565.164241:0:11869:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783947565.164281:0:11869:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1783947565.164289:0:11869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783947565.302505:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947565.302691:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297875200 00000100:00100000:3.0:1783947565.302701:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297875200 00000100:00100000:3.0:1783947565.302757:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00100000:3.0:1783947565.302768:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+17:10449:x1870604297875200:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1783947565.302793:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947565.302814:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb230c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab0d6 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.303061:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb2313 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.303077:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb2313 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.303095:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb2313 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947565.303107:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1783947565.303460:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb230c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0d6 expref: 20 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.303481:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb2313 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0d6 expref: 19 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.303489:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:3.0:1783947565.303491:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783947565.303495:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1aa00, rc 0) 00000100:00100000:3.0:1783947565.303556:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:10449:x1870604297875200:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 789us (1058us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1783947565.303564:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00100000:2.0:1783947565.312611:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947565.314788:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297875328 00000100:00100000:3.0:1783947565.314804:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297875328 00000100:00100000:1.0:1783947565.318834:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 85 00000100:00100000:1.0:1783947565.318848:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb660b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:10449:x1870604297875328:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:1.0:1783947565.318922:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2321 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.318954:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2321 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.318966:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2321 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.318982:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2328 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.318989:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.318996:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319739:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb232f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319754:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb232f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319764:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb232f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947565.319804:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb232f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319816:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2321 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319822:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2321 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319840:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2321 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319846:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947565.319851:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2321 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319859:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2321 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319871:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:1.0:1783947565.319874:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947565.319878:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2321 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319884:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2321 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319895:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319902:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2328 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319907:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2328 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319912:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947565.319916:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2328 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319932:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2328 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319940:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b3c82977a00) 00010000:00010000:1.0:1783947565.319942:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947565.319945:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2328 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319951:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2328 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319967:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb232f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319973:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb232f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319979:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb232f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319983:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73ae00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947565.319986:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb232f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319991:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb232f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.319998:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c82977400) 00010000:00010000:1.0:1783947565.320000:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947565.320002:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb232f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.320017:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb232f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947565.320097:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb660b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:10449:x1870604297875328:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 1249us (7492us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947565.320107:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 85 00010000:00010000:0.0:1783947565.369665:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947565.389067:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947565.389551:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297875584 00000100:00100000:2.0:1783947565.389561:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297875584 00000100:00100000:2.0:1783947565.389623:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 86 00000100:00100000:2.0:1783947565.389633:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:10452:x1870604297875584:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1783947565.389655:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947565.389690:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2336 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab0dd expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.389780:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb233d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.389796:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb233d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.389807:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb233d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.389821:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2344 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.389828:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.389835:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.390148:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb234b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.390158:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb234b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.390165:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb234b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947565.390175:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1783947565.390269:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb233d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.390277:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb233d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.390289:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb233d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.390295:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947565.390299:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb233d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.390306:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb233d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.390316:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:2.0:1783947565.390320:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947565.390323:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb233d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.390329:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb233d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.390340:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.390345:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2344 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.390350:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.390354:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630a00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947565.390357:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.390371:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2344 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.390378:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b3c84bc6d00) 00010000:00010000:2.0:1783947565.390381:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947565.390383:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2344 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.390389:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2344 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.390496:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2336 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0dd expref: 22 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.390510:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb234b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0dd expref: 21 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.390517:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6b00) 00010000:00010000:2.0:1783947565.390520:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947565.390522:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630c00, rc 0) 00000100:00100000:2.0:1783947565.390579:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:10452:x1870604297875584:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 947us (1521us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1783947565.390588:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 86 00000100:00100000:1.0:1783947565.402103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947565.402733:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297875712 00000100:00100000:2.0:1783947565.402744:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297875712 00000100:00100000:2.0:1783947565.402804:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 87 00000100:00100000:2.0:1783947565.402816:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:10452:x1870604297875712:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:2.0:1783947565.402898:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2359 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.402916:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.402927:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.402952:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.402959:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2359 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.402967:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.402974:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631a00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947565.402979:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.402987:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2359 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.402999:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6b00) 00010000:00010000:2.0:1783947565.403002:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947565.403007:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2359 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.403014:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2359 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947565.403215:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:10452:x1870604297875712:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 400us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947565.403223:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 87 00000100:00100000:1.0:1783947565.412581:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947565.412730:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297875968 00000100:00100000:3.0:1783947565.412741:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297875968 00000100:00100000:3.0:1783947565.412803:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:3.0:1783947565.412815:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85b99850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:10452:x1870604297875968:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1783947565.415263:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85b99850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+22:10452:x1870604297875968:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 2441us (2681us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1783947565.415277:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:3.0:1783947565.463488:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947565.466213:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297876224 00000100:00100000:2.0:1783947565.466229:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297876224 00000100:00100000:2.0:1783947565.466352:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:2.0:1783947565.466363:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+22:9980:x1870604297876224:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1783947565.466390:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947565.466409:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2360 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab0e4 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.466533:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2367 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.466548:0:6613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb234b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0dd expref: 23 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.466559:0:6613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2367 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.466592:0:6613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb234b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0dd expref: 23 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.466605:0:6613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb234b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0dd expref: 23 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947565.466620:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb660aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6613:1870604319918336:192.168.203.32@tcp:104: 00000100:00100000:2.0:1783947565.466751:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672900 going to sleep for 11 seconds 00000100:00100000:1.0:1783947565.477840:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947565.478005:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297876352 00000100:00100000:3.0:1783947565.478017:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297876352 00010000:00010000:3.0:1783947565.478127:0:8318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb234b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0dd expref: 24 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947565.478179:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:3.0:1783947565.478190:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:2353:x1870604297876352:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947565.478204:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947565.478212:0:8318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb234b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0dd expref: 24 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.478225:0:8318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb234b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0dd expref: 24 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.478250:0:8318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6b00) 00010000:00010000:3.0:1783947565.478255:0:8318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2367 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.478265:0:8318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2367 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.478274:0:8318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2367 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.478292:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947565.478352:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:2353:x1870604297876352:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 163us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947565.478360:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 47 00010000:00010000:2.0:1783947565.478593:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb234b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0dd expref: 23 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947565.478609:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb660aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6613:1870604319918336:192.168.203.32@tcp:104: 00010000:00010000:2.0:1783947565.478630:0:6613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2367 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.478638:0:6613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2367 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.478643:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2367 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947565.478661:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1783947565.478822:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2360 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0e4 expref: 24 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.478838:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2367 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0e4 expref: 23 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.478845:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6b00) 00010000:00010000:2.0:1783947565.478848:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783947565.478850:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630a00, rc 0) 00000100:00100000:2.0:1783947565.478877:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:9980:x1870604297876224:12345-192.168.203.32@tcp:101:bash.0 Request processed in 12517us (15404us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1783947565.478884:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:1.0:1783947565.482998:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947565.483311:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297876608 00000100:00100000:2.0:1783947565.483341:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297876608 00000100:00100000:2.0:1783947565.483400:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 89 00000100:00100000:2.0:1783947565.483474:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:9980:x1870604297876608:12345-192.168.203.32@tcp:36:bash.0 00010000:00010000:2.0:1783947565.483757:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2375 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.483776:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2375 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.483789:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2375 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783947565.483842:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1783947565.483869:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af678e2b reply state 000000000563618c transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2375 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947565.483879:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1783947565.484068:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1783947565.484188:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+27:9980:x1870604297876608:12345-192.168.203.32@tcp:36:bash.0 Request processed in 769us (1197us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1783947565.484196:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 89 00000020:00080000:2.0:1783947565.484201:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1783947565.488332:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:2.0:1783947565.488449:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2375 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.488461:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2375 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.488469:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2375 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.488476:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631800 already unused, calling callback (ffffffffc1f904f0) 00000100:00100000:0.0:1783947565.488493:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297876736 00010000:00010000:2.0:1783947565.488495:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2375 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947565.488505:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297876736 00010000:00010000:2.0:1783947565.488507:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2375 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.488527:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6b00) 00010000:00010000:2.0:1783947565.488531:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947565.488536:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2375 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.488543:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2375 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947565.488562:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 90 00000100:00100000:0.0:1783947565.488573:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+26:9980:x1870604297876736:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1783947565.488597:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947565.488615:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb237c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab0eb expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.488669:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb237c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0eb expref: 27 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.488683:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb237c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0eb expref: 27 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.488700:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6b00) 00010000:00010000:0.0:1783947565.488703:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947565.488705:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671800, rc 0) 00000100:00100000:0.0:1783947565.488769:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+27:9980:x1870604297876736:12345-192.168.203.32@tcp:101:bash.0 Request processed in 197us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947565.488776:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 90 00000100:00100000:0.0:1783947565.492609:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947565.492774:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297876864 00000100:00100000:2.0:1783947565.492783:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297876864 00000100:00100000:2.0:1783947565.492843:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:2.0:1783947565.492853:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:9980:x1870604297876864:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1783947565.492871:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947565.492891:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004515bda1/0x20c3e53e78bb2383 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab0f2 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783947565.492917:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a54e12b, atime: 0x6a54e129, ctime: 0x6a54e12b, blocks: 0xb 00010000:00010000:2.0:1783947565.492952:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1783947565.492957:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947565.492965:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004515bda1/0x20c3e53e78bb2383 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0f2 expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.492980:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004515bda1/0x20c3e53e78bb2383 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0f2 expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.493008:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631a00, rc 0) 00000100:00100000:2.0:1783947565.493076:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:9980:x1870604297876864:12345-192.168.203.32@tcp:101:bash.0 Request processed in 224us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947565.493084:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:2.0:1783947565.497613:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947565.497705:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297876992 00000100:00100000:1.0:1783947565.497716:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297876992 00002000:00010000:1.0:1783947565.497760:0:6595:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1783947565.497765:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3cb660aa00 with x1870604297876992 ext(0->18446744073709551615) 00002000:00010000:1.0:1783947565.497778:0:6595:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b3cb660aa00. 00000100:00100000:1.0:1783947565.497816:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:1.0:1783947565.497826:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb660aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2354:x1870604297876992:12345-192.168.203.32@tcp:10:bash.0 00002000:00010000:1.0:1783947565.498146:0:6595:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1783947565.498150:0:6595:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1783947563 -> 1783947564 00002000:00010000:1.0:1783947565.498152:0:6595:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1783947561 -> 1783947561 00002000:00010000:1.0:1783947565.498154:0:6595:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783947563 -> 1783947564 00002000:00010000:1.0:1783947565.498156:0:6595:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1783947565.498223:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb660aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2354:x1870604297876992:12345-192.168.203.32@tcp:10:bash.0 Request processed in 397us (620us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1783947565.498231:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00002000:00010000:1.0:1783947565.498248:0:6595:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1783947565.498251:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3cb660aa00 with x1870604297876992 ext(0->18446744073709551615) 00002000:00010000:1.0:1783947565.498257:0:6595:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b3cb660aa00. 00000100:00100000:3.0:1783947565.601302:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947565.601616:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297877120 00000100:00100000:2.0:1783947565.601627:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297877120 00000100:00100000:0.0:1783947565.606202:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 91 00000100:00100000:0.0:1783947565.606218:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+27:10466:x1870604297877120:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:0.0:1783947565.606304:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb238a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.606321:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb238a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.606332:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb238a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.606347:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb2391 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.606366:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb2391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.606372:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb2391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607106:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2398 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607119:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2398 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607126:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2398 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947565.607182:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2398 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607192:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb238a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607198:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb238a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607204:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb238a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607210:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947565.607214:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb238a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607220:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb238a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607231:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:0.0:1783947565.607234:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947565.607238:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb238a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607244:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb238a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607258:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb2391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607264:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb2391 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607275:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb2391 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607279:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947565.607282:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb2391 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607287:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb2391 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607293:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b3c8281b000) 00010000:00010000:0.0:1783947565.607295:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947565.607298:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb2391 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607303:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb2391 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607317:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2398 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607322:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2398 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607327:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2398 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607331:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947565.607333:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2398 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607890:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2398 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607900:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6b00) 00010000:00010000:0.0:1783947565.607903:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947565.607907:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2398 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.607912:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2398 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947565.608075:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+27:10466:x1870604297877120:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 1856us (6777us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947565.608084:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 91 00000100:00100000:0.0:1783947565.677656:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947565.677775:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297877376 00000100:00100000:3.0:1783947565.677785:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297877376 00000100:00100000:3.0:1783947565.677844:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 92 00000100:00100000:3.0:1783947565.677854:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+27:10469:x1870604297877376:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1783947565.677872:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947565.677891:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb239f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab0f9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.677958:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb23a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.677972:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb23a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.677984:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb23a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.677997:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb23ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.678003:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb23ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.678010:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb23ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.678689:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb23b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.678701:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb23b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.678717:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb23b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947565.678728:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783947565.679082:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb23a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.679090:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb23a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.679105:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb23a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.679111:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947565.679115:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb23a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.679123:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb23a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.679144:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:3.0:1783947565.679147:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947565.679151:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb23a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.679157:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb23a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.679170:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb23ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.679176:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb23ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.679189:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb23ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.679195:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947565.679198:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb23ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.679204:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb23ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.679213:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b3c84af9100) 00010000:00010000:3.0:1783947565.679215:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947565.679218:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb23ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.679224:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb23ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.679266:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb239f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0f9 expref: 30 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.679278:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb23b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0f9 expref: 29 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.679285:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6b00) 00010000:00010000:3.0:1783947565.679287:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783947565.679389:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a800, rc 0) 00000100:00100000:3.0:1783947565.679689:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+29:10469:x1870604297877376:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1834us (2041us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1783947565.679707:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 92 00000100:00100000:2.0:1783947565.689554:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947565.690544:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297877504 00000100:00100000:1.0:1783947565.690557:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297877504 00000100:00100000:1.0:1783947565.690691:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:1.0:1783947565.690704:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+29:10469:x1870604297877504:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:1.0:1783947565.690777:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb23c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.690797:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2367 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0e4 expref: 29 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.690807:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb23c2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.690842:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2367 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0e4 expref: 29 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.690857:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2367 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0e4 expref: 29 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947565.690873:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb655c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5795:1870604319918464:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947565.690985:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cc01eef00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947565.694846:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947565.694901:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb655c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5795:1870604319918464:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947565.694930:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb23c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947565.695056:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297877760 00000100:00100000:2.0:1783947565.695064:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297877760 00000100:00100000:2.0:1783947565.695241:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:2.0:1783947565.695251:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+30:5571:x1870604297877760:12345-192.168.203.32@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783947565.695638:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+31:5571:x1870604297877760:12345-192.168.203.32@tcp:35:ldlm_bl.0 Request processed in 387us (800us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1783947565.695645:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:2.0:1783947565.699385:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947565.699569:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297877888 00000100:00100000:1.0:1783947565.699579:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297877888 00010000:00010000:1.0:1783947565.699619:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2367 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0e4 expref: 31 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947565.699693:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:1.0:1783947565.699703:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb660b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+31:2354:x1870604297877888:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947565.699717:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947565.699724:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2367 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0e4 expref: 31 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.699736:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2367 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0e4 expref: 31 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.699758:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2367 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0e4 expref: 31 pid: 6613 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.699773:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6b00) 00010000:00010000:1.0:1783947565.699777:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb23c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.699786:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb23c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.699794:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb23c2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.699835:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947565.699908:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb660b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+30:2354:x1870604297877888:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 207us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947565.699916:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 48 00010000:00010000:0.0:1783947565.700170:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb23c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.700181:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb23c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.700219:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb23c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.700226:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb23c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.700233:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb23c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.700252:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947565.700258:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb23c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.700267:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb23c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.700278:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6b00) 00010000:00010000:0.0:1783947565.700281:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783947565.700285:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb23c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.700292:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb23c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947565.700390:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+29:10469:x1870604297877504:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 9688us (10845us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947565.700400:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:2.0:1783947565.703220:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947565.703316:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297878144 00000100:00100000:3.0:1783947565.703326:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297878144 00000100:00100000:3.0:1783947565.703382:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:3.0:1783947565.703392:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+29:10469:x1870604297878144:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1783947565.704189:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+30:10469:x1870604297878144:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 793us (975us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1783947565.704200:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:3.0:1783947565.813995:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947565.814330:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297878400 00000100:00100000:0.0:1783947565.814340:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297878400 00000100:00100000:0.0:1783947565.814406:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 94 00000100:00100000:0.0:1783947565.814647:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+30:10480:x1870604297878400:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:0.0:1783947565.814675:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947565.814695:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb23c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab100 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.814768:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.814799:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.814811:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.814826:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.814833:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.814840:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.815211:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb23de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.815222:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb23de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.815229:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb23de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947565.815240:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1783947565.815326:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.815334:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.815341:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.815354:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947565.815359:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.815367:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.815378:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:0.0:1783947565.815380:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947565.815385:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.815391:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.815405:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.815410:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.817750:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.817770:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947565.817777:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.817786:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.817903:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b3c8281b000) 00010000:00010000:0.0:1783947565.817907:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947565.817912:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.817920:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.817989:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb23c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab100 expref: 33 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.818005:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb23de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab100 expref: 32 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.818012:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6b00) 00010000:00010000:0.0:1783947565.818015:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947565.818018:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670600, rc 0) 00000100:00100000:0.0:1783947565.818084:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+32:10480:x1870604297878400:12345-192.168.203.32@tcp:101:cat.0 Request processed in 3667us (4096us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1783947565.818093:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 94 00000100:00100000:1.0:1783947565.825644:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947565.825735:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297878656 00000100:00100000:2.0:1783947565.825744:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297878656 00000100:00100000:2.0:1783947565.825805:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:2.0:1783947565.825815:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+32:10480:x1870604297878656:12345-192.168.203.32@tcp:35:cat.0 00000100:00100000:2.0:1783947565.826058:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+33:10480:x1870604297878656:12345-192.168.203.32@tcp:35:cat.0 Request processed in 244us (424us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1783947565.826067:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:2.0:1783947565.856866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947565.857039:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297878912 00000100:00100000:0.0:1783947565.857049:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297878912 00000100:00100000:0.0:1783947565.857115:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 95 00000100:00100000:0.0:1783947565.857125:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+33:10481:x1870604297878912:12345-192.168.203.32@tcp:36:rm.0 00010000:00010000:0.0:1783947565.857194:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783947565.857220:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb23de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab100 expref: 33 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.857261:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb23b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0f9 expref: 32 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.857274:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb237c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0eb expref: 31 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.857285:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c84bc6b00) 00010000:00010000:0.0:1783947565.857619:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783947565.857674:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb23ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.857689:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb23ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.857698:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb23ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.857712:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.857720:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.857727:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.858045:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.858054:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.858068:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783947565.858712:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1783947565.858722:0:5798:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381129303219ns, next at 382129301402ns, rc = 0 00010000:00010000:0.0:1783947565.858778:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2401 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.858787:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2401 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.858795:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2401 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.858802:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2401 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.858809:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2401 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.858815:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2401 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.858899:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947565.858931:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.858937:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23fa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.858943:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.858956:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947565.858961:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.858968:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23fa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.858978:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c8281b600) 00010000:00010000:0.0:1783947565.858981:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783947565.858985:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23fa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.858990:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb23fa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.859007:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb23ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.859013:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb23ec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.859018:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb23ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.859023:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947565.859026:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb23ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.859031:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb23ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.859049:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:0.0:1783947565.859051:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947565.859055:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb23ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947565.859061:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb23ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947565.859072:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000079b25dc9 reply state 000000005f44eb0b transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947565.859081:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783947565.859225:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+32:10481:x1870604297878912:12345-192.168.203.32@tcp:36:rm.0 Request processed in 2098us (2364us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1783947565.859234:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 95 00010000:00010000:3.0:1783947565.862945:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947565.862960:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2401 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.862970:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670400 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947565.862974:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2401 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.862982:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2401 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.862999:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b3c8281b600) 00010000:00010000:3.0:1783947565.863002:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783947565.863006:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2401 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.863012:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2401 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947565.863035:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947565.863053:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947565.863055:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947565.866262:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.866278:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.866286:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.866291:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947565.866296:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.866303:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.866318:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b3c8281b000) 00010000:00010000:1.0:1783947565.866322:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947565.866326:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.866406:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb23f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947565.939995:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947565.940125:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297879168 00000100:00100000:1.0:1783947565.940144:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297879168 00000100:00100000:1.0:1783947565.940212:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 96 00000100:00100000:1.0:1783947565.940222:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+31:10487:x1870604297879168:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1783947565.940265:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947565.940286:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2408 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab107 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.940475:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb240f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.940491:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb240f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.940503:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb240f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.940517:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2416 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.940524:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2416 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.940531:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2416 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783947565.941154:0:6613:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1783947565.941311:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb241d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.941322:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb241d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.941329:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb241d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.941375:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb240f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.941382:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb240f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.941388:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb240f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.941395:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947565.941399:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb240f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.941407:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb240f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.941451:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:1.0:1783947565.941455:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947565.941459:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb240f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.941465:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb240f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947565.941477:0:6613:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b7752f31 reply state 0000000051b954d9 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2416 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947565.941487:0:6613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783947565.941517:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2408 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab107 expref: 34 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.941543:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb241d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab107 expref: 33 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.941551:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c82977a00) 00010000:00010000:1.0:1783947565.941553:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947565.941555:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73bc00, rc 0) 00000100:00100000:1.0:1783947565.941617:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+34:10487:x1870604297879168:12345-192.168.203.32@tcp:101:bash.0 Request processed in 1396us (1632us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1783947565.941625:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 96 00000100:00100000:3.0:1783947565.946676:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947565.947316:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297879296 00000100:00100000:1.0:1783947565.947326:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297879296 00000100:00100000:1.0:1783947565.947408:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:1.0:1783947565.947455:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2353:x1870604297879296:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1783947565.947474:0:8151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947565.947497:0:8151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000564ca829/0x20c3e53e78bb242b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab10e expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783947565.947525:0:8151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947565.947544:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=381s v=(0 0) 00010000:00010000:1.0:1783947565.947548:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947565.947556:0:8151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000564ca829/0x20c3e53e78bb242b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab10e expref: 8 pid: 8151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.947577:0:8151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000564ca829/0x20c3e53e78bb242b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab10e expref: 8 pid: 8151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.947612:0:8151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a200, rc 0) 00000100:00100000:1.0:1783947565.947667:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2353:x1870604297879296:12345-192.168.203.32@tcp:101:bash.0 Request processed in 250us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947565.947674:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00080000:3.0:1783947565.948939:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783947565.949385:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2416 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.949397:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2416 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.949405:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2416 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.949411:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947565.949529:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2416 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.949539:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2416 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.949555:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b3c82977400) 00010000:00010000:2.0:1783947565.949558:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947565.949562:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2416 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.949568:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2416 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947565.962675:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947565.962793:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297879424 00000100:00100000:1.0:1783947565.962819:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297879424 00000100:00100000:1.0:1783947565.962879:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:1.0:1783947565.962888:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:10487:x1870604297879424:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1783947565.962908:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947565.963125:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000099b04e6/0x20c3e53e78bb2432 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab115 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.963168:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000564ca829/0x20c3e53e78bb242b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab10e expref: 9 pid: 8151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.963178:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947565.963183:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947565.963188:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000099b04e6/0x20c3e53e78bb2432 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab115 expref: 9 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.963221:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000564ca829/0x20c3e53e78bb242b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab10e expref: 9 pid: 8151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.963233:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000564ca829/0x20c3e53e78bb242b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab10e expref: 9 pid: 8151 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947565.963261:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb655f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1870604319918592:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947565.963940:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cc01eef00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947565.968038:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb655f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1870604319918592:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947565.968076:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000099b04e6/0x20c3e53e78bb2432 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab115 expref: 9 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947565.968098:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73b600, rc 0) 00000100:00100000:1.0:1783947565.968172:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:10487:x1870604297879424:12345-192.168.203.32@tcp:101:bash.0 Request processed in 5284us (5505us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947565.968180:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:3.0:1783947565.969508:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947565.969695:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297879552 00000100:00100000:2.0:1783947565.969703:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297879552 00010000:00010000:2.0:1783947565.969743:0:8318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000564ca829/0x20c3e53e78bb242b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab10e expref: 9 pid: 8151 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947565.969813:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:2.0:1783947565.969822:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c856ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2354:x1870604297879552:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947565.969838:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947565.969862:0:8318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000564ca829/0x20c3e53e78bb242b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab10e expref: 9 pid: 8151 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.969875:0:8318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000564ca829/0x20c3e53e78bb242b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab10e expref: 9 pid: 8151 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.969898:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000564ca829/0x20c3e53e78bb242b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab10e expref: 9 pid: 8151 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.969913:0:8318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947565.969918:0:8318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947565.969934:0:8318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000099b04e6/0x20c3e53e78bb2432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab115 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.969944:0:8318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000099b04e6/0x20c3e53e78bb2432 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab115 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947565.969981:0:8318:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000099b04e6/0x20c3e53e78bb2432 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab115 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947565.969995:0:8318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd49d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8318:1870604319918720:192.168.203.32@tcp:105: 00000100:00100000:2.0:1783947565.970084:0:8318:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672900 going to sleep for 11 seconds 00000100:00100000:3.0:1783947565.980583:0:8318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd49d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8318:1870604319918720:192.168.203.32@tcp:105: 00010000:00010000:3.0:1783947565.980611:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947565.980671:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c856ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2354:x1870604297879552:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 10850us (11169us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947565.980682:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:2.0:1783947565.981310:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947565.981461:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297879808 00000100:00100000:0.0:1783947565.981471:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297879808 00000100:00100000:0.0:1783947565.981515:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:0.0:1783947565.981525:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+33:10487:x1870604297879808:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:0.0:1783947565.981854:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+34:10487:x1870604297879808:12345-192.168.203.32@tcp:35:bash.0 Request processed in 330us (546us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1783947565.981862:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:2.0:1783947566.247078:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947566.247218:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297879936 00000100:00100000:1.0:1783947566.247228:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297879936 00000100:00100000:1.0:1783947566.247303:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:1.0:1783947566.247316:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+34:10503:x1870604297879936:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1783947566.247343:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947566.247368:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2439 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab11c expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.247493:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2440 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.247509:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.247521:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947566.247600:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1783947566.247604:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783947566.247629:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.247660:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2439 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab11c expref: 36 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.247678:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab11c expref: 35 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.247687:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:1.0:1783947566.247690:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947566.247694:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a200, rc 0) 00000100:00100000:1.0:1783947566.247749:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+35:10503:x1870604297879936:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 436us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947566.247757:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:1.0:1783947566.254233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947566.254740:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297880192 00000100:00100000:2.0:1783947566.254751:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297880192 00000100:00100000:2.0:1783947566.254810:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00100000:2.0:1783947566.254820:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+35:10503:x1870604297880192:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1783947566.254841:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947566.254865:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630800/0x20c3e53e78bb2447 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab123 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947566.254969:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb244e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947566.254983:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb244e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947566.254994:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb244e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947566.255005:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783947566.256449:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630800/0x20c3e53e78bb2447 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab123 expref: 38 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947566.256478:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb244e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab123 expref: 37 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947566.256488:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c82977a00) 00010000:00010000:2.0:1783947566.256491:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947566.256511:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631e00, rc 0) 00000100:00100000:2.0:1783947566.256589:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+37:10503:x1870604297880192:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1769us (2363us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1783947566.256598:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00100000:2.0:1783947566.263499:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947566.263547:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947566.263662:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297880320 00000100:00100000:1.0:1783947566.263675:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297880320 00000100:00100000:1.0:1783947566.263753:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:1.0:1783947566.263764:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+37:2353:x1870604297880320:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947566.263781:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947566.263811:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb244e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab123 expref: 37 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.263833:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c82977a00) 00010000:00010000:1.0:1783947566.263856:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947566.263912:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+36:2353:x1870604297880320:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 150us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947566.263920:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:0.0:1783947566.267645:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297880576 00000100:00100000:0.0:1783947566.267660:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297880576 00000100:00100000:1.0:1783947566.268128:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 99 00000100:00100000:1.0:1783947566.268165:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+36:10503:x1870604297880576:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1783947566.268193:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947566.268214:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb245c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab12a expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.268380:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2463 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.268395:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2463 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.268406:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2463 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947566.268517:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1783947566.268644:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb245c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab12a expref: 39 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.268661:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2463 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab12a expref: 38 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.268669:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c82977a00) 00010000:00010000:1.0:1783947566.268672:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783947566.268675:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73b000, rc 0) 00000100:00100000:1.0:1783947566.268807:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+38:10503:x1870604297880576:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 645us (5258us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1783947566.268815:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 99 00000100:00100000:1.0:1783947566.274367:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947566.274595:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297880704 00000100:00100000:3.0:1783947566.274608:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297880704 00000100:00100000:3.0:1783947566.274697:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:3.0:1783947566.274708:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2354:x1870604297880704:12345-192.168.203.32@tcp:1:lfs.0 00010000:00010000:3.0:1783947566.274753:0:8151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df56adca/0x20c3e53e78bb2471 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.274774:0:8151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000099b04e6/0x20c3e53e78bb2432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab115 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.274782:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947566.274787:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783947566.274791:0:8151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df56adca/0x20c3e53e78bb2471 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.274827:0:8151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000099b04e6/0x20c3e53e78bb2432 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab115 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.274858:0:8151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000099b04e6/0x20c3e53e78bb2432 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab115 expref: 8 pid: 6592 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947566.274873:0:8151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8151:1870604319918848:192.168.203.32@tcp:104: 00000100:00100000:3.0:1783947566.274999:0:8151:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad698c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947566.278148:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947566.278226:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297880832 00000100:00100000:3.0:1783947566.278236:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297880832 00002000:00100000:3.0:1783947566.278326:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8b3cbd49ed80 x1870604297880832/t0(0) o4->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:357/0 lens 504/0 e 0 to 0 dl 1783947577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783947566.278337:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3cbd49ed80 with x1870604297880832 ext(0->8) 00010000:00010000:3.0:1783947566.278346:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000099b04e6/0x20c3e53e78bb2432 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab115 expref: 9 pid: 6592 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.278362:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000099b04e6/0x20c3e53e78bb2432 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab115 expref: 9 pid: 6592 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947566.278371:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b3cbd49ed80 00000100:00100000:3.0:1783947566.278405:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:3.0:1783947566.278414:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2354:x1870604297880832:12345-192.168.203.32@tcp:4:lfs.0 00000100:00100000:3.0:1783947566.278897:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+11:2354:x1870604297880832:12345-192.168.203.32@tcp:4:lfs.0 Request processed in 484us (765us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1783947566.278906:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00002000:00100000:3.0:1783947566.278914:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8b3cbd49ed80 x1870604297880832/t4294967302(0) o4->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:357/0 lens 504/448 e 0 to 0 dl 1783947577 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783947566.278932:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3cbd49ed80 with x1870604297880832 ext(0->8) 00010000:00010000:3.0:1783947566.278938:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000099b04e6/0x20c3e53e78bb2432 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab115 expref: 11 pid: 6592 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.278951:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000099b04e6/0x20c3e53e78bb2432 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab115 expref: 11 pid: 6592 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947566.278958:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b3cbd49ed80 00000100:00100000:1.0:1783947566.282499:0:8151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8151:1870604319918848:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947566.282535:0:8151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df56adca/0x20c3e53e78bb2471 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947566.282783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947566.282940:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297880960 00000100:00100000:3.0:1783947566.282947:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297880960 00010000:00010000:3.0:1783947566.282984:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000099b04e6/0x20c3e53e78bb2432 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab115 expref: 11 pid: 6592 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947566.283056:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:3.0:1783947566.283066:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+11:2355:x1870604297880960:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947566.283081:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1783947566.283100:0:5782:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783947566.283103:0:5782:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783947565 00002000:00010000:3.0:1783947566.283106:0:5782:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783947565 00002000:00010000:3.0:1783947566.283108:0:5782:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1783947565 00010000:00010000:3.0:1783947566.283113:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000099b04e6/0x20c3e53e78bb2432 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab115 expref: 11 pid: 6592 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.283126:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000099b04e6/0x20c3e53e78bb2432 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab115 expref: 11 pid: 6592 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.283182:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000099b04e6/0x20c3e53e78bb2432 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab115 expref: 11 pid: 6592 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.283196:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783947566.283200:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783947566.283205:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df56adca/0x20c3e53e78bb2471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.283215:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df56adca/0x20c3e53e78bb2471 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.283245:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947566.283307:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+10:2355:x1870604297880960:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 243us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947566.283315:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 50 00010000:00010000:1.0:1783947566.283959:0:8151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df56adca/0x20c3e53e78bb2471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.283969:0:8151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df56adca/0x20c3e53e78bb2471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.283993:0:8151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df56adca/0x20c3e53e78bb2471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.284000:0:8151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df56adca/0x20c3e53e78bb2471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.284007:0:8151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df56adca/0x20c3e53e78bb2471 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.284014:0:8151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a600 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947566.284018:0:8151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df56adca/0x20c3e53e78bb2471 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.284041:0:8151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df56adca/0x20c3e53e78bb2471 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.284054:0:8151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df56adca/0x20c3e53e78bb2471 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.284061:0:8151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df56adca/0x20c3e53e78bb2471 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947566.284142:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2354:x1870604297880704:12345-192.168.203.32@tcp:1:lfs.0 Request processed in 9426us (9775us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947566.284150:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:2.0:1783947566.288235:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947566.288330:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297881216 00000100:00100000:0.0:1783947566.288341:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297881216 00000100:00100000:0.0:1783947566.288398:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:0.0:1783947566.288409:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85b9b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+38:10503:x1870604297881216:12345-192.168.203.32@tcp:35:lfs.0 00000004:00010000:0.0:1783947566.288521:0:5799:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2463 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab12a expref: 38 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783947566.288755:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1783947566.288948:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1783947566.289298:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1783947566.289354:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2478 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.289370:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb241d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab107 expref: 42 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.289379:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2478 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.289410:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb241d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab107 expref: 42 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.289965:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb241d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab107 expref: 42 pid: 6613 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947566.289982:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1870604319918976:192.168.203.32@tcp:104: 00000100:00100000:0.0:1783947566.290072:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e42c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947566.294645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947566.294751:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1870604319918976:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947566.294776:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2478 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947566.294863:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297881344 00000100:00100000:1.0:1783947566.294870:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297881344 00010000:00010000:1.0:1783947566.294906:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb241d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab107 expref: 43 pid: 6613 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947566.294944:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:1.0:1783947566.294953:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+43:2353:x1870604297881344:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947566.294967:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947566.294974:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb241d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab107 expref: 43 pid: 6613 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.294984:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb241d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab107 expref: 43 pid: 6613 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.295022:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb241d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab107 expref: 43 pid: 6613 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.295037:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c82977a00) 00010000:00010000:1.0:1783947566.295041:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2478 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.295050:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2478 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.295056:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2478 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.295085:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947566.295157:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+42:2353:x1870604297881344:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 205us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947566.295164:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00010000:00010000:0.0:1783947566.296956:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2478 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.296970:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2478 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783947566.297113:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1783947566.297333:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1783947566.297479:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1870604319919104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783947566.297538:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947566.297560:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e42240 going to sleep for 11 seconds 00000100:00100000:1.0:1783947566.297760:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319919104 00000100:00100000:1.0:1783947566.297769:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319919104 00000100:00100000:1.0:1783947566.297832:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783947566.297842:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5799:x1870604319919104:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783947566.297935:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5799:x1870604319919104:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 95us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947566.297944:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783947566.298689:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1870604319919104:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783947566.299214:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1783947566.299718:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1870604319919232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783947566.299777:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947566.299807:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e42540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947566.299911:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319919232 00000100:00100000:1.0:1783947566.299918:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319919232 00000100:00100000:1.0:1783947566.299958:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783947566.299967:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5799:x1870604319919232:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783947566.300162:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5799:x1870604319919232:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 196us (384us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1783947566.300170:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947566.300359:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1870604319919232:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783947566.300620:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1783947566.300673:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2478 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.300683:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2478 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.300695:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2478 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.300701:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947566.300706:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2478 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.300715:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2478 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.300746:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c82977a00) 00010000:00010000:0.0:1783947566.300748:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783947566.300753:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2478 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.300760:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2478 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783947566.300985:0:5799:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783947566.301091:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1783947566.301103:0:5799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381571683931ns, next at 382571681011ns, rc = 0 00000001:00080000:0.0:1783947566.301110:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1783947566.301161:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c82977a00) 00010000:00010000:0.0:1783947566.301165:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783947566.301173:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2463 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab12a expref: 46 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947566.301786:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85b9b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+45:10503:x1870604297881216:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 13376us (13558us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1783947566.301854:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 26 00000020:00080000:0.0:1783947566.301860:0:5799:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1783947566.302126:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947566.305624:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947566.305774:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297881472 00000100:00100000:3.0:1783947566.305784:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297881472 00000100:00100000:3.0:1783947566.306047:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 100 00000100:00100000:3.0:1783947566.306057:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+45:10503:x1870604297881472:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1783947566.306081:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947566.306117:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb247f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab131 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.306193:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb247f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab131 expref: 46 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.306208:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb247f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab131 expref: 46 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.306229:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:3.0:1783947566.306232:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783947566.306236:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1ae00, rc 0) 00000100:00100000:3.0:1783947566.306468:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+46:10503:x1870604297881472:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 411us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947566.306475:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 100 00000100:00100000:2.0:1783947566.310888:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947566.310991:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297881728 00000100:00100000:3.0:1783947566.311001:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297881728 00000100:00100000:3.0:1783947566.311088:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:3.0:1783947566.311098:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+46:10503:x1870604297881728:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1783947566.311399:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+47:10503:x1870604297881728:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 302us (518us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1783947566.311407:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 27 00010000:00010000:0.0:1783947566.394123:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947566.397325:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947566.397563:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297881856 00000100:00100000:1.0:1783947566.397577:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297881856 00000100:00100000:1.0:1783947566.397659:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 101 00000100:00100000:1.0:1783947566.397670:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+47:10513:x1870604297881856:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:1.0:1783947566.397781:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2486 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.397815:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2486 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.397829:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2486 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.397848:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb248d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.397853:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb248d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.397860:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb248d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.397988:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2494 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.397998:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398027:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947566.398082:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398098:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2486 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398105:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2486 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398112:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2486 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398119:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73bc00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947566.398124:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2486 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398519:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2486 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398630:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:1.0:1783947566.398633:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947566.398640:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2486 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398648:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2486 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398666:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb248d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398687:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb248d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398694:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb248d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398699:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947566.398703:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb248d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398710:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb248d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398717:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b3c82977500) 00010000:00010000:1.0:1783947566.398719:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947566.398722:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb248d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398727:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb248d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398758:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398765:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2494 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398771:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2494 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398776:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73ae00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947566.398795:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2494 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398802:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2494 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398810:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:1.0:1783947566.398812:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947566.398815:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2494 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.398821:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2494 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947566.399003:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+47:10513:x1870604297881856:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 1331us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947566.399014:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 101 00000100:00100000:2.0:1783947566.437094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947566.437353:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297882112 00000100:00100000:1.0:1783947566.437366:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297882112 00000100:00100000:1.0:1783947566.437532:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 102 00000100:00100000:1.0:1783947566.437545:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+47:10516:x1870604297882112:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1783947566.437574:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947566.437603:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb249b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab138 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.437707:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb24a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.437725:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb24a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.437762:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb24a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.437780:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb24a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.437789:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb24a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.437975:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb24a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.438159:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb24b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.438169:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb24b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.438177:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb24b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947566.438189:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1783947566.438328:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb24a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.438336:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb24a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.438343:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb24a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.438350:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947566.438363:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb24a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.438373:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb24a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.438388:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:1.0:1783947566.438392:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947566.438397:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb24a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.438405:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb24a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.438523:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb24a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.438531:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb24a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.438537:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb24a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.438542:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73bc00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947566.438545:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb24a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.438550:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb24a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.438560:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b3c82977500) 00010000:00010000:1.0:1783947566.438562:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947566.438573:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb24a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.438580:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb24a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.438641:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb249b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab138 expref: 50 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.438656:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb24b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab138 expref: 49 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.438666:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:1.0:1783947566.438669:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947566.438672:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a600, rc 0) 00000100:00100000:1.0:1783947566.438764:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+49:10516:x1870604297882112:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1221us (1683us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1783947566.438774:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 102 00000100:00100000:2.0:1783947566.442290:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947566.442545:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297882240 00000100:00100000:1.0:1783947566.442554:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297882240 00000100:00100000:1.0:1783947566.442687:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 103 00000100:00100000:1.0:1783947566.442702:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+49:10516:x1870604297882240:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:1.0:1783947566.442776:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.442793:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.442804:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.442850:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.442857:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.442863:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.442870:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947566.442874:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.442881:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.442893:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:1.0:1783947566.442896:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947566.442900:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.442907:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947566.442983:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+49:10516:x1870604297882240:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 285us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947566.442990:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 103 00000100:00100000:0.0:1783947566.451616:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947566.452031:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297882496 00000100:00100000:3.0:1783947566.452044:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297882496 00000100:00100000:3.0:1783947566.452185:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:3.0:1783947566.452197:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+49:10516:x1870604297882496:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1783947566.452578:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+50:10516:x1870604297882496:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 382us (976us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1783947566.452605:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:2.0:1783947566.562854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947566.563261:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297882752 00000100:00100000:3.0:1783947566.563278:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297882752 00000100:00100000:3.0:1783947566.563501:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 104 00000100:00100000:3.0:1783947566.563514:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+50:10526:x1870604297882752:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1783947566.563551:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947566.563555:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783947566.563592:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2440 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab11c expref: 50 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.563614:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:3.0:1783947566.563621:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947566.563639:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb24c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab13f expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.563783:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb24cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.563801:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb24cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.563814:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb24cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947566.563842:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1783947566.566561:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb24c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab13f expref: 52 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.566638:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb24cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab13f expref: 51 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.566649:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:3.0:1783947566.566653:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947566.566657:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a400, rc 0) 00000100:00100000:3.0:1783947566.566779:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+51:10526:x1870604297882752:12345-192.168.203.32@tcp:101:bash.0 Request processed in 3267us (3933us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1783947566.566791:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 104 00000100:00100000:0.0:1783947566.583878:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947566.584004:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297883008 00000100:00100000:1.0:1783947566.584077:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297883008 00000100:00100000:1.0:1783947566.584168:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 105 00000100:00100000:1.0:1783947566.584353:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+51:10526:x1870604297883008:12345-192.168.203.32@tcp:36:bash.0 00010000:00010000:1.0:1783947566.584634:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783947566.584776:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb24cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab13f expref: 51 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.584810:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb24b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab138 expref: 50 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.584822:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:1.0:1783947566.584828:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947566.585172:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.585258:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.585272:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783947566.585331:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1783947566.585358:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c4cc8607 reply state 00000000d81852c9 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947566.585370:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783947566.585688:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+52:10526:x1870604297883008:12345-192.168.203.32@tcp:36:bash.0 Request processed in 1493us (1822us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1783947566.585697:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 105 00000020:00080000:1.0:1783947566.585704:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783947566.588389:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:1.0:1783947566.588533:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.588579:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.588589:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.588597:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947566.588603:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.588613:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.588634:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:1.0:1783947566.588638:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947566.588644:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.588651:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb24da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947566.599330:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297883136 00000100:00100000:2.0:1783947566.599354:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297883136 00000100:00100000:2.0:1783947566.599482:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 106 00000100:00100000:2.0:1783947566.599495:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+51:10526:x1870604297883136:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1783947566.599532:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947566.599563:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb24e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab146 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947566.599673:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb24e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947566.599692:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb24e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947566.599706:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb24e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947566.599765:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783947566.599771:0:6613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783947566.599793:0:6613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb24e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947566.599824:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb24e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab146 expref: 53 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947566.599845:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb24e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab146 expref: 52 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947566.599855:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:2.0:1783947566.599859:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947566.599862:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631800, rc 0) 00000100:00100000:2.0:1783947566.599952:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+52:10526:x1870604297883136:12345-192.168.203.32@tcp:101:bash.0 Request processed in 459us (11578us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947566.599961:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 106 00000100:00100000:2.0:1783947566.608760:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947566.608884:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297883392 00000100:00100000:0.0:1783947566.608916:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297883392 00000100:00100000:0.0:1783947566.608992:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:0.0:1783947566.609005:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+52:10526:x1870604297883392:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:0.0:1783947566.609596:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+53:10526:x1870604297883392:12345-192.168.203.32@tcp:35:bash.0 Request processed in 590us (848us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1783947566.609606:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:0.0:1783947566.670320:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947566.670468:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297883520 00000100:00100000:2.0:1783947566.670482:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297883520 00000100:00100000:0.0:1783947566.670680:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 107 00000100:00100000:0.0:1783947566.670700:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+53:10532:x1870604297883520:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1783947566.670738:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947566.670767:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb24ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab14d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.670858:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb24f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.670876:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb24f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.670890:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb24f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947566.670975:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1783947566.670980:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783947566.671007:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb24f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.671036:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb24ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab14d expref: 55 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.671088:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb24f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab14d expref: 54 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.671099:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:0.0:1783947566.671102:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947566.671107:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670e00, rc 0) 00000100:00100000:0.0:1783947566.671362:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+54:10532:x1870604297883520:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 668us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947566.671372:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 107 00000100:00100000:2.0:1783947566.682146:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947566.682234:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297883648 00000100:00100000:3.0:1783947566.682246:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297883648 00000100:00100000:3.0:1783947566.682361:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 108 00000100:00100000:3.0:1783947566.682373:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+54:10532:x1870604297883648:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1783947566.682406:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947566.682474:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb24fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab154 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.682557:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2504 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.682575:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2504 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.682588:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2504 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.682607:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb250b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.682633:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb250b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.682641:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb250b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683253:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2512 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683266:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683275:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947566.683552:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783947566.683557:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783947566.683581:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683596:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683607:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2504 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683614:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2504 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683632:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2504 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683639:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1ba00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947566.683644:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2504 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683655:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2504 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683669:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:0.0:1783947566.683672:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947566.683678:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2504 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683686:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2504 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683704:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb250b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683711:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb250b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683718:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb250b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683724:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947566.683727:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb250b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683743:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb250b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683751:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b3c84af9b00) 00010000:00010000:0.0:1783947566.683754:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947566.683757:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb250b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683764:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb250b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683805:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb24fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab154 expref: 56 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683821:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2512 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab154 expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.683830:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:0.0:1783947566.683832:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947566.683835:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671e00, rc 0) 00000100:00100000:0.0:1783947566.683968:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+55:10532:x1870604297883648:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1595us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947566.683978:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 108 00000100:00100000:2.0:1783947566.692882:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947566.692946:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947566.693053:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297884032 00000100:00100000:3.0:1783947566.693066:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297884032 00000100:00100000:3.0:1783947566.693161:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:3.0:1783947566.693173:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+55:2353:x1870604297884032:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947566.693195:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947566.693227:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2512 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab154 expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.693253:0:8318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:3.0:1783947566.693259:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947566.693342:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+54:2353:x1870604297884032:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 172us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947566.693352:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:1.0:1783947566.694090:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297883904 00000100:00100000:1.0:1783947566.694098:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297883904 00000100:00100000:1.0:1783947566.694159:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 109 00000100:00100000:1.0:1783947566.694168:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+54:10532:x1870604297883904:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1783947566.694191:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947566.694211:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2519 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab15b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.694573:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2520 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.694607:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb24e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab146 expref: 55 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.694618:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2520 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.694660:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb24e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab146 expref: 55 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.694676:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb24e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab146 expref: 55 pid: 6613 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947566.694693:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb655ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1870604319919360:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947566.694845:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cc01ee3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947566.707026:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947566.707098:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297884160 00000100:00100000:3.0:1783947566.707111:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297884160 00010000:00010000:3.0:1783947566.707171:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb24e8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab146 expref: 56 pid: 6613 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947566.707220:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:3.0:1783947566.707230:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+56:2353:x1870604297884160:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947566.707250:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947566.707277:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb24e8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab146 expref: 56 pid: 6613 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.707359:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb24e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab146 expref: 56 pid: 6613 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.707391:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:3.0:1783947566.707551:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2520 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.707566:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2520 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.707575:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2520 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.707726:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb24e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab146 expref: 56 pid: 6613 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947566.707744:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb655ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1870604319919360:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947566.707773:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2520 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.710716:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947566.710879:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+55:2353:x1870604297884160:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 3637us (3855us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947566.710895:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 52 00010000:00010000:1.0:1783947566.711058:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2520 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.711071:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2520 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947566.711101:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1783947566.711355:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2519 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab15b expref: 56 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.711379:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2520 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab15b expref: 55 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.711389:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:1.0:1783947566.711392:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783947566.711581:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a600, rc 0) 00000100:00100000:1.0:1783947566.711622:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+55:10532:x1870604297883904:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 17455us (18756us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1783947566.711632:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 109 00000100:00100000:2.0:1783947566.714933:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947566.715047:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297884416 00000100:00100000:3.0:1783947566.715061:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297884416 00000100:00100000:3.0:1783947566.715193:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:3.0:1783947566.715205:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+55:10532:x1870604297884416:12345-192.168.203.32@tcp:103:lfs.0 00010000:00010000:3.0:1783947566.715226:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947566.715258:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb247f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab131 expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947566.715291:0:8318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:3.0:1783947566.715298:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947566.715364:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+54:10532:x1870604297884416:12345-192.168.203.32@tcp:103:lfs.0 Request processed in 161us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947566.715372:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:2.0:1783947566.717674:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947566.717775:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297884544 00000100:00100000:3.0:1783947566.717789:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297884544 00000100:00100000:1.0:1783947566.718034:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 110 00000100:00100000:1.0:1783947566.718046:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+54:10532:x1870604297884544:12345-192.168.203.32@tcp:58:lfs.0 00010000:00010000:1.0:1783947566.718186:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb252e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.718207:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb252e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947566.718221:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb252e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783947566.718687:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1783947566.719596:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+54:10532:x1870604297884544:12345-192.168.203.32@tcp:58:lfs.0 Request processed in 1542us (1925us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947566.719611:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 110 00000100:00100000:2.0:1783947566.722164:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947566.722358:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297884672 00000100:00100000:0.0:1783947566.722378:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297884672 00000100:00100000:0.0:1783947566.722686:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 111 00000100:00100000:0.0:1783947566.722700:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+54:10532:x1870604297884672:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1783947566.722729:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947566.722759:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb2535 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab162 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.722846:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb252e lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.722860:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb2535 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab162 expref: 55 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.722882:0:5795:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb252e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.722896:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb2535 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab162 expref: 55 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.722912:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:0.0:1783947566.722915:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947566.722921:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb2535 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab162 expref: 55 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947566.722930:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671c00, rc 0) 00000100:00100000:0.0:1783947566.723049:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+55:10532:x1870604297884672:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 352us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947566.723057:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 111 00000040:00080000:2.0:1783947567.162251:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947567.162260:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947567.162318:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1783947567.162326:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783947567.165744:0:11551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb65b2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870604319919488:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783947567.165955:0:11551:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672780 going to sleep for 11 seconds 00000100:00100000:0.0:1783947567.168864:0:11551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb65b2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870604319919488:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783947567.172963:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947567.173379:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297884800 00000100:00100000:0.0:1783947567.173390:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297884800 00000100:00080000:3.0:1783947567.173522:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947567.173803:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 112 00000100:00100000:0.0:1783947567.173815:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+55:10533:x1870604297884800:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783947567.173849:0:5797:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783947567.173976:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+55:10533:x1870604297884800:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 162us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947567.173983:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 112 00000100:00100000:2.0:1783947567.176246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947567.176345:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297884928 00000100:00100000:1.0:1783947567.176367:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297884928 00000100:00100000:1.0:1783947567.176460:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00100000:1.0:1783947567.176470:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+55:10533:x1870604297884928:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783947567.176533:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb253c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.176549:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb253c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.176569:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb253c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.176921:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2543 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.176933:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2543 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.176940:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2543 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.176967:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb254a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.176976:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb254a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.176983:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb254a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947567.177017:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783947567.177022:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783947567.177042:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb254a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177053:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb253c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177059:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb253c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177066:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb253c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177071:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947567.177075:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb253c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177083:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb253c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177096:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b3c84bc6300) 00010000:00010000:1.0:1783947567.177099:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947567.177103:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb253c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177109:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb253c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177121:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2543 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177137:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2543 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177143:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2543 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177155:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73bc00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947567.177158:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2543 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177165:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2543 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177173:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8b3c82977500) 00010000:00010000:1.0:1783947567.177176:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947567.177178:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2543 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177184:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2543 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177200:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb254a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177206:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb254a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177212:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb254a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177217:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947567.177220:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb254a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177225:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb254a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177241:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:1.0:1783947567.177243:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947567.177246:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb254a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.177252:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb254a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947567.177322:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+55:10533:x1870604297884928:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 Request processed in 852us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947567.177330:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00100000:2.0:1783947567.179987:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947567.180209:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297885184 00000100:00100000:0.0:1783947567.180217:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297885184 00000100:00100000:0.0:1783947567.180313:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 114 00000100:00100000:0.0:1783947567.180324:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+55:10533:x1870604297885184:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947567.180348:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947567.180368:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2551 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab169 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.180525:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2558 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.180541:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.180551:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947567.180572:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783947567.180679:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.180699:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2558 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.180705:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2558 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.180711:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947567.180715:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2558 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.180722:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2558 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.180734:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:0.0:1783947567.180737:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783947567.180741:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2558 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.180748:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2558 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.180791:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2551 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab169 expref: 57 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.180801:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b3c84bc6300) 00010000:00010000:0.0:1783947567.180803:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783947567.180807:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2551 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab169 expref: 57 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.180818:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670c00, rc 0) 00000100:00100000:0.0:1783947567.180879:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+56:10533:x1870604297885184:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 553us (897us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1783947567.180887:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 114 00000100:00100000:2.0:1783947567.185073:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947567.185790:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297885312 00000100:00100000:1.0:1783947567.185802:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297885312 00000100:00100000:1.0:1783947567.185868:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 115 00000100:00100000:1.0:1783947567.185879:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+56:10533:x1870604297885312:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783947567.185936:0:6613:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783947567.186039:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+56:10533:x1870604297885312:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 161us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947567.186047:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 115 00000100:00100000:2.0:1783947567.191816:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947567.192350:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297885568 00000100:00100000:3.0:1783947567.192361:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297885568 00000100:00100000:3.0:1783947567.192451:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 116 00000100:00100000:3.0:1783947567.192462:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+56:10533:x1870604297885568:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947567.192482:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947567.192485:0:6613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783947567.192511:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb24f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab14d expref: 56 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.192541:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:3.0:1783947567.192546:0:6613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947567.192568:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb2566 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab170 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783947567.193814:0:6613:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1783947567.194038:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb256d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.194053:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb256d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.194063:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb256d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.194457:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb2566 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab170 expref: 58 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.194494:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb256d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab170 expref: 57 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.194503:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b3c84af9600) 00010000:00010000:3.0:1783947567.194506:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947567.194509:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a600, rc 0) 00000100:00100000:3.0:1783947567.194572:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+57:10533:x1870604297885568:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 2111us (3044us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1783947567.194581:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 116 00000100:00100000:1.0:1783947567.201192:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947567.201963:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297885824 00000100:00100000:0.0:1783947567.201975:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297885824 00000100:00100000:0.0:1783947567.202039:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:0.0:1783947567.202049:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+57:10533:x1870604297885824:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783947567.202106:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947567.202144:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb256d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab170 expref: 57 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202163:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b3c84af9600) 00010000:00010000:0.0:1783947567.202173:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783947567.202195:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb257b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202209:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb257b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202218:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb257b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202233:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2582 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x4ecd89d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202239:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2582 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4ecd89d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202244:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2582 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4ecd89d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202349:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb257b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202357:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb257b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202363:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb257b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202370:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670c00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947567.202374:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb257b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202381:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb257b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202390:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:0.0:1783947567.202393:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947567.202397:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb257b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202402:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb257b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202414:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2582 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4ecd89d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202469:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2582 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4ecd89d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202475:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2582 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4ecd89d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202486:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947567.202489:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2582 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4ecd89d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202495:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2582 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4ecd89d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202503:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x4ecd89d2 (ffff8b3c8281be00) 00010000:00010000:0.0:1783947567.202505:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947567.202508:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2582 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4ecd89d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.202513:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2582 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4ecd89d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947567.202615:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+56:10533:x1870604297885824:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 566us (1429us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783947567.202623:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:2.0:1783947567.219145:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947567.219902:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297885952 00000100:00100000:0.0:1783947567.219914:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297885952 00000100:00100000:0.0:1783947567.220062:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00100000:0.0:1783947567.220082:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+56:10533:x1870604297885952:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947567.220102:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947567.220134:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2589 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab177 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.220168:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2590 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.220545:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.220559:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.220676:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2589 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab177 expref: 58 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.220696:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2590 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab177 expref: 57 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.220706:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b3c8281be00) 00010000:00010000:0.0:1783947567.220708:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783947567.220711:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670c00, rc 0) 00000100:00100000:0.0:1783947567.220787:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+57:10533:x1870604297885952:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 715us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947567.220794:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00100000:1.0:1783947567.225644:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947567.236611:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297886208 00000100:00100000:0.0:1783947567.236627:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297886208 00000100:00100000:1.0:1783947567.237837:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 119 00000100:00100000:1.0:1783947567.237849:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+57:10533:x1870604297886208:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783947567.237944:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2597 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.237960:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2597 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.237986:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2597 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783947567.238354:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1783947567.238364:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382508945188ns, next at 383508943061ns, rc = 0 00000004:00010000:1.0:1783947567.238528:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000073aa754c reply state 00000000da9f45b7 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2597 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947567.238538:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783947567.238643:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+59:10533:x1870604297886208:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 795us (13011us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1783947567.238651:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 119 00000100:00100000:1.0:1783947567.244844:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:2.0:1783947567.244875:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2597 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.244890:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2597 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.244899:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2597 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.244905:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947567.244910:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2597 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.244918:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2597 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.244933:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b3c8281be00) 00010000:00010000:2.0:1783947567.244936:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783947567.244955:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2597 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.244962:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2597 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947567.245753:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297886336 00000100:00100000:3.0:1783947567.245764:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297886336 00000100:00100000:3.0:1783947567.245857:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 120 00000100:00100000:3.0:1783947567.245867:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+58:10533:x1870604297886336:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947567.245891:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947567.245909:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb259e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab17e expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.245962:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb259e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab17e expref: 59 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.245975:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb259e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab17e expref: 59 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.245989:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b3c8281be00) 00010000:00010000:3.0:1783947567.245992:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783947567.246005:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1ae00, rc 0) 00000100:00100000:3.0:1783947567.246375:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+59:10533:x1870604297886336:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 508us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947567.246382:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 120 00000100:00100000:2.0:1783947567.252811:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947567.253064:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297886464 00000100:00100000:0.0:1783947567.253074:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297886464 00000100:00100000:0.0:1783947567.253160:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:0.0:1783947567.253171:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2353:x1870604297886464:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783947567.253541:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2353:x1870604297886464:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 370us (737us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1783947567.253549:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00080000:3.0:1783947567.253673:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947567.257592:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947567.257694:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297886720 00000100:00100000:3.0:1783947567.257718:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297886720 00000100:00100000:3.0:1783947567.257811:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:3.0:1783947567.257822:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+59:10533:x1870604297886720:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783947567.258272:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+60:10533:x1870604297886720:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 451us (687us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1783947567.258281:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:2.0:1783947567.262604:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947567.263150:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297886976 00000100:00100000:1.0:1783947567.263160:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297886976 00000100:00100000:1.0:1783947567.263259:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 121 00000100:00100000:1.0:1783947567.263269:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+60:10533:x1870604297886976:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783947567.263401:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+60:10533:x1870604297886976:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 133us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947567.263463:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 121 00000100:00100000:2.0:1783947567.267164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947567.267257:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297887104 00000100:00100000:0.0:1783947567.267267:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297887104 00000100:00100000:0.0:1783947567.267333:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 122 00000100:00100000:0.0:1783947567.267343:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+60:10533:x1870604297887104:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947567.267364:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947567.267387:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb25a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab185 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.267493:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb25ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.267510:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb25ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.267521:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb25ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947567.267560:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783947567.267592:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb25ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.267620:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb25a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab185 expref: 62 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.267641:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb25ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab185 expref: 61 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.267650:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b3c8281be00) 00010000:00010000:0.0:1783947567.267652:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783947567.267656:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671400, rc 0) 00000100:00100000:0.0:1783947567.267730:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+61:10533:x1870604297887104:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 387us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947567.267737:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 122 00000100:00100000:2.0:1783947567.271536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947567.271671:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297887232 00000100:00100000:0.0:1783947567.271681:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297887232 00000100:00100000:0.0:1783947567.271743:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:0.0:1783947567.271754:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2354:x1870604297887232:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947567.271772:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947567.271793:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb25b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab18c expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783947567.271818:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54e12e, blocks: 0x1 00010000:00010000:0.0:1783947567.271834:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=382s v=(0 0) 00010000:00010000:0.0:1783947567.271838:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947567.271845:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb25b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab18c expref: 10 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.271858:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb25b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab18c expref: 10 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.271868:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671800, rc 0) 00000100:00100000:0.0:1783947567.271915:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+10:2354:x1870604297887232:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 164us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947567.271920:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:2.0:1783947567.275334:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947567.275590:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297887488 00000100:00100000:3.0:1783947567.275599:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297887488 00000100:00100000:3.0:1783947567.275658:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 123 00000100:00100000:3.0:1783947567.275668:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+61:10533:x1870604297887488:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783947567.275809:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+61:10533:x1870604297887488:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 142us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947567.275817:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 123 00000100:00100000:2.0:1783947567.278812:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947567.278942:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297887616 00000100:00100000:0.0:1783947567.278952:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297887616 00000100:00100000:0.0:1783947567.279017:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:0.0:1783947567.279027:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+10:10533:x1870604297887616:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947567.279045:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947567.279062:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8e975f9/0x20c3e53e78bb25ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab193 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.279091:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb25b3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab18c expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.279099:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947567.279103:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947567.279108:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8e975f9/0x20c3e53e78bb25ba lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab193 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.279152:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb25b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab18c expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.279165:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb25b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab18c expref: 11 pid: 6591 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947567.279178:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1870604319919616:192.168.203.32@tcp:104: 00000100:00100000:0.0:1783947567.279278:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e42a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947567.283378:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1870604319919616:192.168.203.32@tcp:104: 00010000:00010000:0.0:1783947567.283415:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f8e975f9/0x20c3e53e78bb25ba lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab193 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947567.283658:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:0.0:1783947567.283777:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671000, rc 0) 00000100:00100000:1.0:1783947567.284763:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297887744 00000100:00100000:1.0:1783947567.284773:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297887744 00010000:00010000:1.0:1783947567.284864:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb25b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab18c expref: 12 pid: 6591 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947567.284951:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:1.0:1783947567.284974:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c856ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+12:2353:x1870604297887744:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947567.284989:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947567.285010:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb25b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab18c expref: 12 pid: 6591 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.285024:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb25b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab18c expref: 12 pid: 6591 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.285047:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb25b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab18c expref: 12 pid: 6591 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.285064:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947567.285069:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947567.285077:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8e975f9/0x20c3e53e78bb25ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab193 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.285087:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8e975f9/0x20c3e53e78bb25ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab193 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.285119:0:5783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f8e975f9/0x20c3e53e78bb25ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab193 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947567.285144:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb655c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5783:1870604319919744:192.168.203.32@tcp:105: 00000100:00100000:1.0:1783947567.285228:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cc01ee3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947567.285255:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+11:10533:x1870604297887616:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 6229us (6452us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947567.285268:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:1.0:1783947567.290395:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb655c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5783:1870604319919744:192.168.203.32@tcp:105: 00010000:00010000:1.0:1783947567.290519:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947567.292065:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c856ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+10:2353:x1870604297887744:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 7080us (8395us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947567.292082:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:2.0:1783947567.293797:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947567.293872:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297887872 00000100:00100000:1.0:1783947567.293882:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297887872 00002000:00100000:1.0:1783947567.293925:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8b3cb65b1500 x1870604297887872/t0(0) o4->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:358/0 lens 504/0 e 0 to 0 dl 1783947578 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783947567.293936:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3cb65b1500 with x1870604297887872 ext(0->12) 00002000:00010000:1.0:1783947567.293942:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b3cb65b1500 00000100:00100000:1.0:1783947567.293973:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:1.0:1783947567.293983:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+10:2353:x1870604297887872:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783947567.294707:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+12:2353:x1870604297887872:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 Request processed in 723us (916us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783947567.294717:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00002000:00100000:1.0:1783947567.294724:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8b3cb65b1500 x1870604297887872/t4294967308(0) o4->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:358/0 lens 504/448 e 0 to 0 dl 1783947578 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783947567.294733:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3cb65b1500 with x1870604297887872 ext(0->12) 00002000:00010000:1.0:1783947567.294736:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b3cb65b1500 00000100:00100000:2.0:1783947567.298785:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947567.298874:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297888000 00000100:00100000:0.0:1783947567.298882:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297888000 00000100:00100000:0.0:1783947567.298928:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 124 00000100:00100000:0.0:1783947567.298947:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+61:10533:x1870604297888000:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783947567.337721:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000004:00080000:3.0:1783947567.337741:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:2.0:1783947567.337882:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+58:10533:x1870604297888000:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 Request processed in 38931us (39100us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947567.337894:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 124 00000020:00080000:3.0:1783947567.338961:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b3c87e42240 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1783947567.338969:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b3b84b98900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b3c87e42b40 00000020:00080000:3.0:1783947567.338972:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b3b84b98000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b3b84173800 00000004:00080000:3.0:1783947567.339002:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1783947567.339057:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b3c87e42d80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1783947567.339074:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b3b84b98600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b3c87e42f00 00000020:00080000:3.0:1783947567.339076:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b3b84b98b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b3c8664e000 00000001:00080000:3.0:1783947567.339091:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:3.0:1783947567.339095:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1783947567.339133:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1783947567.339310:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1783947567.339540:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947567.339557:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319919872:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783947567.339610:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947567.339664:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319919872 00000100:00100000:0.0:1783947567.339670:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319919872 00000100:00100000:0.0:1783947567.339709:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783947567.339716:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3313:x1870604319919872:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783947567.339739:0:8151:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1783947567.339767:0:8151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a54e12d, atime: 0x6a54e12d, ctime: 0x6a54e12d, blocks: 0x1 00010000:00010000:0.0:1783947567.339774:0:8151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb25c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.339790:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=382s v=(0 0) 00010000:00010000:0.0:1783947567.339795:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947567.339801:0:8151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb25c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.339816:0:8151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb25c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.339838:0:8151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb25c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.339847:0:8151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb25c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.339861:0:8151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783947567.340252:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3313:x1870604319919872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 535us (640us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1783947567.340260:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1783947567.340292:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947567.340298:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb25c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.340306:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670600 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947567.340311:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb25c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.340320:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb25c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.340335:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb25c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.340343:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb25c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.340370:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947567.340372:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947567.340373:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783947567.340399:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b3cbd9bca80/2, rc 0, transno 4294967304 00000100:00100000:0.0:1783947567.340404:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319919872:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783947567.340777:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb655d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319920128:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783947567.340812:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947567.340836:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783947567.340841:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb655c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319920000:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783947567.340858:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947567.340912:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319920128 00000100:00100000:1.0:1783947567.340918:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319920128 00000100:00100000:1.0:1783947567.341010:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319920000 00000100:00100000:1.0:1783947567.341018:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319920000 00000100:00100000:1.0:1783947567.341035:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783947567.341042:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cc03cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1870604319920128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1783947567.341156:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783947567.341159:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783947566 00002000:00010000:1.0:1783947567.341162:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783947567.341164:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1783947566 -> 1783947566 00002000:00010000:1.0:1783947567.341166:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1783947567.341197:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cc03cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3312:x1870604319920128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 156us (385us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1783947567.341203:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783947567.341343:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783947567.341349:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1870604319920000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783947567.341361:0:6592:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1783947567.341374:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dc721a4/0x20c3e53e78bb25c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.341391:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004515bda1/0x20c3e53e78bb2383 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0f2 expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.341399:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1783947567.341403:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783947567.341407:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dc721a4/0x20c3e53e78bb25c8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.341558:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004515bda1/0x20c3e53e78bb2383 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0f2 expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.341583:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004515bda1/0x20c3e53e78bb2383 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0f2 expref: 11 pid: 6592 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947567.341595:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb655d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1870604319920256:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947567.341646:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cc01ee780 going to sleep for 11 seconds 00000004:00080000:1.0:1783947567.342120:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b3cb655d180/2, rc 0, transno 4294967309 00000100:00100000:1.0:1783947567.342137:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb655d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319920128:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1783947567.342954:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000100:00080000:2.0:1783947567.343525:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947567.345565:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947567.345640:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947567.345727:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297888128 00000100:00100000:1.0:1783947567.345736:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297888128 00000100:00100000:1.0:1783947567.345800:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:1.0:1783947567.345810:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+12:2354:x1870604297888128:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783947567.346062:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297888256 00000100:00100000:0.0:1783947567.346067:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297888256 00010000:00010000:0.0:1783947567.346092:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004515bda1/0x20c3e53e78bb2383 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0f2 expref: 13 pid: 6592 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947567.346137:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:0.0:1783947567.346144:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:2354:x1870604297888256:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947567.346156:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947567.346161:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004515bda1/0x20c3e53e78bb2383 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0f2 expref: 13 pid: 6592 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.346175:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004515bda1/0x20c3e53e78bb2383 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0f2 expref: 13 pid: 6592 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.346201:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783947567.346205:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783947567.346210:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009dc721a4/0x20c3e53e78bb25c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.346220:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dc721a4/0x20c3e53e78bb25c8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.346247:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947567.346310:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:2354:x1870604297888256:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 166us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947567.346317:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 54 00010000:00010000:3.0:1783947567.350087:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004515bda1/0x20c3e53e78bb2383 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0f2 expref: 12 pid: 6592 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947567.350111:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb655d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1870604319920256:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947567.350150:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009dc721a4/0x20c3e53e78bb25c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.350162:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009dc721a4/0x20c3e53e78bb25c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.350169:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dc721a4/0x20c3e53e78bb25c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.350180:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dc721a4/0x20c3e53e78bb25c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.350188:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009dc721a4/0x20c3e53e78bb25c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.350208:0:6592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783947567.350775:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3312:x1870604319920000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9423us (9912us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1783947567.350932:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1783947567.350991:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b3cb655c380/2, rc 0, transno 4294967310 00000100:00100000:3.0:1783947567.350996:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb655c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319920000:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783947567.351214:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947567.351222:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009dc721a4/0x20c3e53e78bb25c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.351230:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a400 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947567.351234:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009dc721a4/0x20c3e53e78bb25c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.351244:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009dc721a4/0x20c3e53e78bb25c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.351262:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009dc721a4/0x20c3e53e78bb25c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.351268:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dc721a4/0x20c3e53e78bb25c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.351296:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947567.351298:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947567.351299:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947567.380861:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+11:2354:x1870604297888128:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 Request processed in 35043us (35295us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947567.380889:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 43 00000001:00080000:3.0:1783947567.380965:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1783947567.380977:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1783947567.380982:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1783947567.383988:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947567.384071:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297888512 00000100:00100000:3.0:1783947567.384081:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297888512 00000100:00100000:3.0:1783947567.384151:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 125 00000100:00100000:3.0:1783947567.384162:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+15:10533:x1870604297888512:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783947567.384213:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947567.384239:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb25ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab185 expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.384257:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b3c8281be00) 00010000:00010000:3.0:1783947567.384262:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947567.384302:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb25cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.384315:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb25cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.384324:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb25cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783947567.384618:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007bc51a84 reply state 0000000016f82cf9 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb25cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947567.384643:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783947567.384733:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+16:10533:x1870604297888512:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 572us (754us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1783947567.384740:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 125 00010000:00010000:3.0:1783947567.387161:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb25cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.387178:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb25cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.387184:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb25cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.387190:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947567.387194:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb25cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.387201:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb25cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.387215:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b3c8281be00) 00010000:00010000:3.0:1783947567.387218:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947567.387222:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb25cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.387229:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb25cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947567.388768:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947567.388964:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297888640 00000100:00100000:1.0:1783947567.388973:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297888640 00000100:00100000:1.0:1783947567.389030:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:1.0:1783947567.389041:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2353:x1870604297888640:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783947567.389254:0:8151:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1783947567.389258:0:8151:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1783947566 -> 1783947565 00002000:00010000:1.0:1783947567.389260:0:8151:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783947565 00002000:00010000:1.0:1783947567.389262:0:8151:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1783947566 -> 1783947565 00002000:00010000:1.0:1783947567.389264:0:8151:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1783947567.389330:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2353:x1870604297888640:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 291us (570us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1783947567.389337:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:1.0:1783947567.392954:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947567.393039:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297888896 00000100:00100000:3.0:1783947567.393047:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297888896 00000100:00100000:3.0:1783947567.393143:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 126 00000100:00100000:3.0:1783947567.393153:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+15:10533:x1870604297888896:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783947567.393211:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb25d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.393226:0:6613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2590 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab177 expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.393235:0:6613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb25d6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.393263:0:6613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2590 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab177 expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.393275:0:6613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2590 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab177 expref: 15 pid: 5795 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947567.393300:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6613:1870604319920384:192.168.203.32@tcp:104: 00000100:00100000:3.0:1783947567.393465:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad6986c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947567.396164:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947567.396241:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297889024 00000100:00100000:2.0:1783947567.396250:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297889024 00010000:00010000:2.0:1783947567.396299:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2590 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab177 expref: 16 pid: 5795 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947567.396337:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:2.0:1783947567.396346:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+16:2354:x1870604297889024:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947567.396360:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947567.396367:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2590 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab177 expref: 16 pid: 5795 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.396379:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2590 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab177 expref: 16 pid: 5795 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.396400:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b3c8281be00) 00010000:00010000:2.0:1783947567.396405:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb25d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.396415:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb25d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.396457:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb25d6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.396474:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947567.396530:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+16:2354:x1870604297889024:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 184us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947567.396538:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 55 00010000:00010000:0.0:1783947567.398282:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb2590 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab177 expref: 15 pid: 5795 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947567.398323:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6613:1870604319920384:192.168.203.32@tcp:104: 00010000:00010000:0.0:1783947567.398346:0:6613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb25d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.398355:0:6613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb25d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.398361:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb25d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.398388:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb25d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.398395:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb25d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.398403:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb25d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.398409:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947567.398413:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb25d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.398450:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb25d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.398465:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b3c8281be00) 00010000:00010000:0.0:1783947567.398469:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783947567.398473:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb25d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.398487:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb25d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947567.398562:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:10533:x1870604297888896:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 Request processed in 5410us (5616us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783947567.398573:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 126 00000100:00100000:1.0:1783947567.401047:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947567.401143:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297889152 00000100:00100000:3.0:1783947567.401152:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297889152 00000100:00100000:3.0:1783947567.401250:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:3.0:1783947567.401259:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2354:x1870604297889152:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783947567.401305:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb25dd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.401323:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8e975f9/0x20c3e53e78bb25ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab193 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.401342:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947567.401346:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783947567.401351:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb25dd lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.401387:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f8e975f9/0x20c3e53e78bb25ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab193 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947567.401399:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f8e975f9/0x20c3e53e78bb25ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab193 expref: 7 pid: 6590 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947567.401413:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1870604319920512:192.168.203.32@tcp:104: 00000100:00100000:3.0:1783947567.401517:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad698780 going to sleep for 11 seconds 00000100:00100000:3.0:1783947567.404803:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947567.404886:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297889280 00000100:00100000:2.0:1783947567.404894:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297889280 00010000:00010000:2.0:1783947567.404932:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f8e975f9/0x20c3e53e78bb25ba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab193 expref: 8 pid: 6590 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947567.404975:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00100000:2.0:1783947567.404985:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2354:x1870604297889280:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947567.405001:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947567.405024:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f8e975f9/0x20c3e53e78bb25ba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab193 expref: 8 pid: 6590 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.405038:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f8e975f9/0x20c3e53e78bb25ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab193 expref: 8 pid: 6590 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.405063:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947567.405068:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947567.405075:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb25dd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.405086:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb25dd lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.405107:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947567.405169:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2354:x1870604297889280:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 185us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947567.405188:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 56 00010000:00010000:0.0:1783947567.405957:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8e975f9/0x20c3e53e78bb25ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab193 expref: 7 pid: 6590 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947567.405974:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1870604319920512:192.168.203.32@tcp:104: 00010000:00010000:0.0:1783947567.405996:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb25dd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.406007:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb25dd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.406014:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb25dd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.406043:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb25dd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.406052:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb25dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.406076:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb25dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.406082:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a000 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947567.406087:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb25dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.406095:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb25dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.406108:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb25dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.406116:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb25dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947567.406187:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297889152:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 Request processed in 4929us (5149us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947567.406195:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:3.0:1783947567.409502:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947567.409599:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297889536 00000100:00100000:1.0:1783947567.409609:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297889536 00000100:00100000:1.0:1783947567.409665:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 127 00000100:00100000:1.0:1783947567.409675:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:10533:x1870604297889536:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783947567.409751:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb25e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.409769:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb25e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.409781:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb25e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.410001:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb25eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.410013:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb259e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab17e expref: 15 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.410022:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb25eb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.410055:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb259e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab17e expref: 15 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.410068:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb259e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab17e expref: 15 pid: 6613 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947567.410100:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb655f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1870604319920640:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947567.410196:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cc01ee6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947567.413637:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb655f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1870604319920640:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947567.413669:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb25eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947567.414765:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947567.414891:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297889664 00000100:00100000:2.0:1783947567.414898:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297889664 00010000:00010000:2.0:1783947567.414933:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb259e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab17e expref: 16 pid: 6613 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947567.414976:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:2.0:1783947567.414984:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+16:2353:x1870604297889664:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947567.414997:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947567.415004:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb259e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab17e expref: 16 pid: 6613 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.415015:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb259e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab17e expref: 16 pid: 6613 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.415038:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb259e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab17e expref: 16 pid: 6613 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.415053:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b3c8281be00) 00010000:00010000:2.0:1783947567.415060:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb25eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.415068:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb25eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.415075:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb25eb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947567.415119:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947567.415178:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+15:2353:x1870604297889664:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 193us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947567.415185:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 57 00010000:00010000:0.0:1783947567.415456:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb25eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.415465:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb25eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783947567.415649:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1783947567.415823:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1783947567.415866:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1783947567.415942:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1870604319920768:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783947567.416004:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947567.416034:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e423c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947567.416059:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319920768 00000100:00100000:0.0:1783947567.416065:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319920768 00000100:00100000:0.0:1783947567.416101:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783947567.416108:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5798:x1870604319920768:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783947567.416187:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5798:x1870604319920768:12345-0@lo:1000:mdt00_002.0 Request processed in 79us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947567.416193:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783947567.416226:0:5798:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1783947567.416231:0:5798:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1783947567.416247:0:5798:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b3cb655d180, transno 4294967309 00000100:00100000:0.0:1783947567.416261:0:5798:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8b3cb655c380 x1870604319920000/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783947583 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947567.416272:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1870604319920768:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1783947567.416722:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1783947567.416769:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1870604319920896:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783947567.416798:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947567.416814:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e42cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947567.416965:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319920896 00000100:00100000:0.0:1783947567.416970:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319920896 00000100:00100000:0.0:1783947567.416994:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783947567.417000:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5798:x1870604319920896:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783947567.417141:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5798:x1870604319920896:12345-0@lo:1000:mdt00_002.0 Request processed in 140us (342us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1783947567.417158:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783947567.417200:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1870604319920896:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1783947567.417223:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb25eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.417231:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb25eb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.417238:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb25eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.417244:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947567.417248:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb25eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.417255:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb25eb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.417268:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b3c8281be00) 00010000:00010000:0.0:1783947567.417271:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947567.417275:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb25eb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.417281:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb25eb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.417305:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb252e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.417311:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb252e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.417326:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb252e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.417331:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73ae00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947567.417333:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb252e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.417339:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb252e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.417346:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:0.0:1783947567.417348:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947567.417355:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb2535 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab162 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.417365:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb2535 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab162 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.417377:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb2535 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab162 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.417402:0:5798:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb2535 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab162 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947567.417413:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1870604319921024:192.168.203.32@tcp:105: 00000100:00100000:0.0:1783947567.417487:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e42cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1783947567.419595:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947567.427002:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947567.427138:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297889792 00000100:00100000:1.0:1783947567.427147:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297889792 00000100:00100000:1.0:1783947567.427201:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:1.0:1783947567.427211:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c8797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:10532:x1870604297889792:12345-192.168.203.32@tcp:49:lfs.0 00000100:00100000:1.0:1783947567.427360:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c8797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:10532:x1870604297889792:12345-192.168.203.32@tcp:49:lfs.0 Request processed in 142us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947567.427368:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:0.0:1783947567.427476:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1870604319921024:192.168.203.32@tcp:105: 00010000:00010000:0.0:1783947567.427513:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb252e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.427523:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb252e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.427555:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb25f2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.427569:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb25f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.427579:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb25f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.427588:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb25f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.427595:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb25f2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.427601:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb25f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.427607:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947567.427611:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb25f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.427617:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb25f2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.427626:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:0.0:1783947567.427629:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947567.427638:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb25f2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.427644:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb25f2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.427656:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb25e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.427662:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb25e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.427667:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb25e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.427673:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947567.427676:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb25e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.427682:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb25e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.427689:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:0.0:1783947567.427692:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783947567.427694:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb25e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.427699:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb25e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947567.427896:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:10533:x1870604297889536:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 18222us (18403us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1783947567.427906:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 127 00000020:00080000:0.0:1783947567.427916:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783947567.428155:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783947567.428160:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783947567.428860:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1783947567.428870:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783947567.437672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947567.437778:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297890048 00000100:00100000:0.0:1783947567.437788:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297890048 00000100:00100000:0.0:1783947567.437847:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 128 00000100:00100000:0.0:1783947567.437857:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:10532:x1870604297890048:12345-192.168.203.32@tcp:58:lfs.0 00000040:00080000:0.0:1783947567.438246:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1783947567.438893:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:10532:x1870604297890048:12345-192.168.203.32@tcp:58:lfs.0 Request processed in 1030us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947567.438904:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 128 00000100:00100000:2.0:1783947567.444185:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947567.444932:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297890304 00000100:00100000:1.0:1783947567.444945:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297890304 00000100:00100000:1.0:1783947567.445454:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:1.0:1783947567.445466:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85b98c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:10533:x1870604297890304:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783947567.448168:0:5800:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783947567.448293:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1783947567.448891:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb25f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.448909:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb25f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.448920:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb25f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.448930:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb25f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.448936:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb25f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.448943:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb25f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.448959:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947567.449094:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947567.449104:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb25f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.449112:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a200 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947567.449116:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb25f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.449136:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb25f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.449152:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b3c82977200) 00010000:00010000:0.0:1783947567.449155:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783947567.449160:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb25f9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.449166:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb25f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.449191:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947567.449193:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947567.449195:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947567.449400:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85b98c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+20:10533:x1870604297890304:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 3931us (5220us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1783947567.449413:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 32 00000020:00080000:1.0:1783947567.449479:0:5800:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783947567.484749:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947567.485660:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297890432 00000100:00100000:0.0:1783947567.485672:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297890432 00000100:00100000:1.0:1783947567.486005:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 129 00000100:00100000:1.0:1783947567.486017:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+20:10535:x1870604297890432:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1783947567.486042:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947567.486069:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2600 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab19a expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.486164:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2607 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.486179:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.486203:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.486219:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb260e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.486226:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb260e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.486233:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb260e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.486616:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2615 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.486629:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2520 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab15b expref: 21 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.486637:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2615 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.486672:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2520 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab15b expref: 21 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.486697:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2520 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab15b expref: 21 pid: 5798 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947567.486712:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb655dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1870604319921152:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947567.486873:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cc01ee9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947567.494749:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947567.495028:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297890688 00000100:00100000:3.0:1783947567.495037:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297890688 00000100:00100000:3.0:1783947567.495088:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:3.0:1783947567.495098:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c8797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+22:5570:x1870604297890688:12345-192.168.203.32@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783947567.495825:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb655dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1870604319921152:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947567.495851:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2615 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947567.495986:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c8797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:5570:x1870604297890688:12345-192.168.203.32@tcp:35:ldlm_bl.0 Request processed in 889us (1246us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1783947567.495995:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:2.0:1783947567.499375:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947567.499686:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297890816 00000100:00100000:0.0:1783947567.499696:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297890816 00010000:00010000:0.0:1783947567.499749:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2520 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab15b expref: 23 pid: 5798 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947567.499788:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 58 00000100:00100000:0.0:1783947567.499798:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87978700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:2354:x1870604297890816:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947567.499814:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947567.499821:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2520 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab15b expref: 23 pid: 5798 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.499833:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2520 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab15b expref: 23 pid: 5798 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.499854:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2520 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab15b expref: 23 pid: 5798 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.499871:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:0.0:1783947567.499876:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2615 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.499885:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.499892:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2615 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947567.499921:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947567.499974:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87978700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+22:2354:x1870604297890816:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 177us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947567.499982:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 58 00010000:00010000:1.0:1783947567.500201:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.500210:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947567.500254:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783947567.500258:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783947567.500288:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.500301:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.500310:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.500317:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2607 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.500334:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2607 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.500340:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947567.500344:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2607 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.500364:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2607 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.500374:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:1.0:1783947567.500377:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947567.500381:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2607 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.500387:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2607 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.500399:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb260e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.500405:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb260e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.500411:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb260e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.500467:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73ae00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947567.500471:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb260e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.500486:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb260e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.500495:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b3c82977500) 00010000:00010000:1.0:1783947567.500497:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947567.500500:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb260e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.500506:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb260e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.500546:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb2600 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab19a expref: 22 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.500559:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2615 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab19a expref: 21 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947567.500566:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:1.0:1783947567.500569:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947567.500571:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73b600, rc 0) 00000100:00100000:1.0:1783947567.500617:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:10535:x1870604297890432:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 14599us (15874us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947567.500625:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 129 00000001:00080000:3.0:1783947567.741310:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1783947567.741338:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:3.0:1783947567.741351:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1783947567.879269:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947567.879317:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947567.879353:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947567.879458:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297890944 00000100:00100000:0.0:1783947567.879468:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297890944 00000100:00100000:0.0:1783947567.879514:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 291 00000100:00100000:0.0:1783947567.879525:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+13:2353:x1870604297890944:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947567.879590:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+13:2353:x1870604297890944:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 66us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947567.879598:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 291 00000100:00100000:1.0:1783947567.879932:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297891200 00000100:00100000:1.0:1783947567.879937:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297891200 00000100:00100000:1.0:1783947567.879987:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 147 00000100:00100000:1.0:1783947567.879994:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c8797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2353:x1870604297891200:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947567.880044:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c8797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2353:x1870604297891200:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 51us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947567.880052:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 147 00000100:00100000:1.0:1783947567.880072:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297891072 00000100:00100000:1.0:1783947567.880075:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297891072 00000100:00100000:1.0:1783947567.880102:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:1.0:1783947567.880109:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2353:x1870604297891072:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947567.880148:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2353:x1870604297891072:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 39us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947567.880153:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00080000:0.0:1783947567.880472:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783947567.880479:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1783947568.272328:0:11923:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947568.272336:0:11923:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947568.272373:0:11923:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783947568.272379:0:11923:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1783947568.442379:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783947568.444719:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783947568.444727:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783947568.444762:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783947568.444769:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783947568.444917:0:11551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c84f51500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870604319921280:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783947568.444999:0:11551:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e42600 going to sleep for 11 seconds 00000100:00100000:0.0:1783947568.457839:0:11551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c84f51500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870604319921280:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783947568.458360:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947568.458458:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297891328 00000100:00100000:0.0:1783947568.458465:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297891328 00000100:00100000:0.0:1783947568.458516:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 130 00000100:00100000:0.0:1783947568.458526:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:10548:x1870604297891328:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783947568.458560:0:5798:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783947568.458662:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:10548:x1870604297891328:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 137us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947568.458670:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 130 00000100:00100000:0.0:1783947568.462623:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947568.462702:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297891584 00000100:00100000:3.0:1783947568.462711:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297891584 00000100:00100000:3.0:1783947568.462779:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 131 00000100:00100000:3.0:1783947568.462789:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:10548:x1870604297891584:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947568.462809:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947568.462873:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb261c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab1a1 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947568.462988:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb2623 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947568.463003:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb2623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947568.463015:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb2623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947568.463026:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783947568.463158:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb261c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1a1 expref: 24 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947568.463175:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb2623 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1a1 expref: 23 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947568.463185:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:3.0:1783947568.463188:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947568.463200:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a800, rc 0) 00000100:00100000:3.0:1783947568.463258:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:10548:x1870604297891584:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 470us (643us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1783947568.463266:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 131 00000100:00100000:1.0:1783947568.469209:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947568.469390:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297891840 00000100:00100000:2.0:1783947568.469401:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297891840 00000100:00100000:2.0:1783947568.469592:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 132 00000100:00100000:2.0:1783947568.469603:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:10548:x1870604297891840:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783947568.469690:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2631 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947568.469708:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947568.469720:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947568.469946:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947568.469955:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2631 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947568.469962:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2631 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947568.469968:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631a00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947568.469972:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2631 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947568.469980:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2631 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947568.469991:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:2.0:1783947568.469995:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783947568.469999:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2631 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947568.470005:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2631 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947568.472085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947568.472209:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297891968 00000100:00100000:3.0:1783947568.472219:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297891968 00000100:00100000:3.0:1783947568.472285:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:3.0:1783947568.472294:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+25:2353:x1870604297891968:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947568.472310:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947568.472330:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a800/0x20c3e53e78bb2623 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1a1 expref: 25 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947568.472345:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:3.0:1783947568.472350:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947568.472405:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:2353:x1870604297891968:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 113us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947568.472413:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:2.0:1783947568.472580:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:10548:x1870604297891840:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 2978us (3378us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1783947568.472589:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 132 00000100:00100000:0.0:1783947568.481335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947568.481406:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297892224 00000100:00100000:3.0:1783947568.481458:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297892224 00000100:00100000:3.0:1783947568.481509:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:3.0:1783947568.481519:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:10548:x1870604297892224:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783947568.481743:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:10548:x1870604297892224:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 226us (417us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1783947568.481752:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:0.0:1783947569.209754:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319921408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947569.209825:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947569.209973:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947569.209991:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319921536:0@lo:400:kworker.0 00000100:00100000:3.0:1783947569.210040:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1870604319921792:0@lo:400:kworker.0 00000100:00100000:0.0:1783947569.210041:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947569.210074:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319921920:0@lo:400:kworker.0 00000100:00100000:1.0:1783947569.210078:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319922048:0@lo:400:kworker.0 00000100:00100000:0.0:1783947569.210102:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947569.210103:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947569.214247:0:11568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319921408 00000100:00100000:2.0:1783947569.214262:0:11568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319921408 00000100:00100000:2.0:1783947569.214352:0:11568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783947569.214376:0:11568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319921408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947569.215960:0:11568:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783947569.218430:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319922048 00000100:00100000:1.0:1783947569.218515:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319922048 00000100:00100000:1.0:1783947569.218589:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783947569.218601:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1870604319922048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947569.218687:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1870604319922048:12345-0@lo:400:kworker.0 Request processed in 90us (8583us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947569.218694:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783947569.218742:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319922048:0@lo:400:kworker.0 00000100:00100000:1.0:1783947569.218792:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319921920 00000100:00100000:1.0:1783947569.218796:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319921920 00000100:00100000:1.0:1783947569.218833:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783947569.218855:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319921920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947569.218891:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319921920:12345-0@lo:400:kworker.0 Request processed in 38us (8788us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947569.218897:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783947569.218921:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319921664:0@lo:400:kworker.0 00000100:00100000:1.0:1783947569.219613:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947569.219668:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319921664 00000100:00100000:1.0:1783947569.219673:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319921664 00000100:00100000:1.0:1783947569.219700:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783947569.219707:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319921664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947569.219743:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319921664:12345-0@lo:400:kworker.0 Request processed in 37us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947569.219750:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783947569.219781:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319921664:0@lo:400:kworker.0 00000100:00080000:1.0:1783947569.219818:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947569.219823:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947569.219826:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947569.219836:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319921536 00000100:00100000:1.0:1783947569.219840:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319921536 00000100:00100000:1.0:1783947569.219864:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1783947569.219869:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319921536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947569.219904:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319921536:12345-0@lo:400:kworker.0 Request processed in 35us (9864us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947569.220148:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319921920:0@lo:400:kworker.0 00000100:00100000:0.0:1783947569.220159:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319921536:0@lo:400:kworker.0 00000100:00100000:1.0:1783947569.221279:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1783947569.224871:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947569.225107:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319921792 00000100:00100000:1.0:1783947569.225129:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319921792 00000100:00100000:1.0:1783947569.225277:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783947569.225288:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870604319921792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947569.225373:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870604319921792:12345-0@lo:400:kworker.0 Request processed in 87us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947569.225381:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783947569.227816:0:11568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319921408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 13432us (17980us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947569.227830:0:11568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783947569.227925:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1783947569.227932:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:1.0:1783947569.227951:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b3cbd03b100, transno 4294967301 00000004:00080000:1.0:1783947569.228007:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1783947569.228018:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b3cbd9bca80, transno 4294967304 00000100:00100000:3.0:1783947569.228080:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1870604319921792:0@lo:400:kworker.0 00000100:00100000:1.0:1783947569.228386:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319921408:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783947569.228626:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783947569.466020:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783947569.532844:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783947569.532854:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783947569.533360:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1783947569.533369:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783947569.722621:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947569.722643:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319922176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947569.722705:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947569.722759:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319922176 00000100:00100000:3.0:1783947569.722766:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319922176 00000100:00100000:3.0:1783947569.722805:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783947569.722813:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85a90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1870604319922176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783947569.722968:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783947569.723014:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85a90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1870604319922176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 201us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947569.723021:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783947569.723242:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319922176:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1783947570.149733:0:11975:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783947570.149742:0:11975:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783947570.149780:0:11975:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783947570.149786:0:11975:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783947570.383093:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947570.383866:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297892480 00000100:00100000:0.0:1783947570.383877:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297892480 00000100:00100000:0.0:1783947570.384007:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 133 00000100:00100000:0.0:1783947570.384020:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:10568:x1870604297892480:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1783947570.384044:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947570.384066:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb2638 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab1a8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947570.384195:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb263f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947570.384209:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb263f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947570.384221:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb263f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947570.384232:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783947570.384357:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb2638 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1a8 expref: 27 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947570.384379:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb263f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1a8 expref: 26 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947570.384387:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:0.0:1783947570.384390:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783947570.384393:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670c00, rc 0) 00000100:00100000:0.0:1783947570.384504:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+26:10568:x1870604297892480:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 488us (1423us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1783947570.384512:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 133 00000100:00080000:1.0:1783947570.384582:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947570.389242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947570.399214:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297892608 00000100:00100000:2.0:1783947570.399231:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297892608 00000100:00100000:0.0:1783947570.399502:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 134 00000100:00100000:0.0:1783947570.399531:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+26:10568:x1870604297892608:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:0.0:1783947570.399602:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb264d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947570.399637:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb264d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947570.399649:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb264d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947570.399676:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb264d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947570.399682:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb264d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947570.399688:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb264d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947570.399695:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947570.399699:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb264d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947570.399706:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb264d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947570.400066:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:0.0:1783947570.400069:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783947570.400074:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb264d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947570.400080:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb264d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947570.400177:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+26:10568:x1870604297892608:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 647us (10942us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947570.400192:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 134 00010000:00010000:3.0:1783947570.489806:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947570.555028:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947570.559198:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297892736 00000100:00100000:2.0:1783947570.559213:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297892736 00000100:00100000:3.0:1783947570.559891:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:3.0:1783947570.559903:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2356:x1870604297892736:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:3.0:1783947570.559931:0:8151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947570.559954:0:8151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000087b9448/0x20c3e53e78bb2654 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab1af expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947570.559984:0:8151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a54e12d, atime: 0x6a54e12d, ctime: 0x6a54e12d, blocks: 0xb 00010000:00010000:3.0:1783947570.560002:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=385s v=(0 0) 00010000:00010000:3.0:1783947570.560007:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947570.560016:0:8151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000087b9448/0x20c3e53e78bb2654 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1af expref: 7 pid: 8151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947570.560072:0:8151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000087b9448/0x20c3e53e78bb2654 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1af expref: 7 pid: 8151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947570.560085:0:8151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a800, rc 0) 00000100:00100000:3.0:1783947570.560212:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2356:x1870604297892736:12345-192.168.203.32@tcp:101:cat.0 Request processed in 312us (5193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947570.560219:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00080000:1.0:1783947570.560612:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947570.570526:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947570.570615:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297892864 00000100:00100000:0.0:1783947570.570624:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297892864 00002000:00100000:0.0:1783947570.570673:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8b3cbd443480 x1870604297892864/t0(0) o3->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:361/0 lens 488/0 e 0 to 0 dl 1783947581 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783947570.570685:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3cbd443480 with x1870604297892864 ext(0->4095) 00002000:00010000:0.0:1783947570.570691:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b3cbd443480 00000100:00100000:0.0:1783947570.570763:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:0.0:1783947570.570773:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2355:x1870604297892864:12345-192.168.203.32@tcp:3:cat.0 00000100:00100000:0.0:1783947570.570983:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2355:x1870604297892864:12345-192.168.203.32@tcp:3:cat.0 Request processed in 211us (465us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1783947570.570991:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00002000:00100000:0.0:1783947570.570998:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8b3cbd443480 x1870604297892864/t0(0) o3->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:361/0 lens 488/4536 e 0 to 0 dl 1783947581 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783947570.571006:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3cbd443480 with x1870604297892864 ext(0->4095) 00002000:00010000:0.0:1783947570.571009:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b3cbd443480 00010000:00010000:0.0:1783947571.514563:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947572.537930:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783947572.852580:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1783947572.852607:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b3c87e423c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1783947572.852612:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b3b85a08d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b3c87e42780 00000020:00080000:3.0:1783947572.852616:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b3b85a08200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b3c8664c400 00000020:00080000:3.0:1783947572.852653:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1783947572.852704:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1783947572.853002:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1783947572.863881:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1783947572.863902:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:0.0:1783947572.997365:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947572.997399:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947572.997476:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947572.997518:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947572.997550:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297893120 00000100:00100000:0.0:1783947572.997561:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947572.997570:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297893120 00000100:00100000:0.0:1783947572.997594:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297893376 00000100:00100000:0.0:1783947572.997605:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297893376 00000100:00100000:0.0:1783947572.997691:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297893248 00000100:00100000:3.0:1783947572.997702:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297893504 00000100:00100000:3.0:1783947572.997708:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297893504 00000100:00100000:0.0:1783947572.997711:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297893248 00000100:00100000:3.0:1783947572.997753:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 151 00000100:00100000:0.0:1783947572.997764:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:3.0:1783947572.997774:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:2355:x1870604297893120:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947572.997786:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2355:x1870604297893376:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947572.997872:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2355:x1870604297893376:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 95us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947572.997882:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:3.0:1783947572.997900:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:2355:x1870604297893120:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 133us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947572.997908:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 66 00000100:00100000:3.0:1783947572.997919:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 151 00000100:00100000:0.0:1783947572.997925:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2355:x1870604297893248:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947572.997947:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 152 00000100:00100000:0.0:1783947572.997964:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2355:x1870604297893248:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 42us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947572.997976:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 66 00000100:00100000:3.0:1783947572.997983:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2355:x1870604297893504:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947572.998029:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2355:x1870604297893504:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 54us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947572.998038:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 152 00000100:00080000:3.0:1783947572.998074:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783947572.998080:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947572.998096:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947572.998884:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297892992 00000100:00100000:2.0:1783947572.998894:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297892992 00000100:00100000:2.0:1783947572.998944:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 293 00000100:00100000:2.0:1783947572.998952:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:2355:x1870604297892992:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947572.999011:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:2355:x1870604297892992:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 59us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947572.999018:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 293 00010000:00010000:0.0:1783947573.563812:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947574.331860:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947574.331884:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319922304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947574.331959:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947574.332130:0:11568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319922304 00000100:00100000:2.0:1783947574.332140:0:11568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319922304 00000100:00100000:1.0:1783947574.332174:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319922432:0@lo:400:kworker.0 00000100:00100000:2.0:1783947574.332207:0:11568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783947574.332221:0:11568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319922304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947574.332256:0:11568:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783947574.332264:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947574.332527:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319922816:0@lo:400:kworker.0 00000100:00080000:3.0:1783947574.332610:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947574.332663:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870604319922560:0@lo:400:kworker.0 00000100:00100000:2.0:1783947574.333118:0:11568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319922304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 896us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947574.333124:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319922944:0@lo:400:kworker.0 00000100:00100000:2.0:1783947574.333138:0:11568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783947574.333173:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947574.333222:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319922432 00000100:00100000:2.0:1783947574.333230:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319922432 00000100:00100000:1.0:1783947574.333240:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319922688:0@lo:400:kworker.0 00000100:00100000:2.0:1783947574.333272:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1783947574.333278:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947574.333285:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319922432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947574.333504:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319922304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947574.333533:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319922432:12345-0@lo:400:kworker.0 Request processed in 249us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947574.333543:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1783947574.333564:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319922944 00000100:00100000:1.0:1783947574.333572:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319922944 00000100:00100000:2.0:1783947574.333624:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319922432:0@lo:400:kworker.0 00000100:00100000:1.0:1783947574.333633:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783947574.333642:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319922944:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783947574.333675:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947574.333717:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319922944:12345-0@lo:400:kworker.0 Request processed in 74us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947574.333718:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319922688 00000100:00100000:2.0:1783947574.333727:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319922688 00000100:00100000:2.0:1783947574.333774:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783947574.333782:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319922688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947574.333838:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947574.333922:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783947574.333975:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319922688:12345-0@lo:400:kworker.0 Request processed in 191us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947574.333983:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783947574.334007:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319922816 00000100:00100000:2.0:1783947574.334011:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319922816 00000100:00100000:1.0:1783947574.334015:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319922688:0@lo:400:kworker.0 00000100:00100000:2.0:1783947574.334138:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783947574.334146:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319922816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947574.334198:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319922816:12345-0@lo:400:kworker.0 Request processed in 53us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947574.334204:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1783947574.334222:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947574.334243:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1783947574.334248:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b3cb655c380, transno 4294967310 00000004:00080000:2.0:1783947574.334257:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1783947574.334285:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319922944:0@lo:400:kworker.0 00000100:00100000:3.0:1783947574.337268:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947574.337525:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319922560 00000100:00100000:1.0:1783947574.337533:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319922816:0@lo:400:kworker.0 00000100:00100000:2.0:1783947574.337535:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319922560 00000100:00100000:2.0:1783947574.337681:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783947574.337695:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870604319922560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947574.337782:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870604319922560:12345-0@lo:400:kworker.0 Request processed in 90us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947574.337843:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870604319922560:0@lo:400:kworker.0 00000100:00100000:2.0:1783947574.341072:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00010000:00010000:1.0:1783947574.586119:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947574.847836:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319923072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947574.847945:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947574.848127:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319923072 00000100:00100000:0.0:1783947574.848138:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319923072 00000100:00100000:0.0:1783947574.848201:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783947574.848211:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319923072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783947574.848258:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947574.849277:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319923072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1055us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947574.849291:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783947574.858990:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319923072:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783947575.610051:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783947575.673781:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783947575.673792:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783947575.673857:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783947575.673865:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783947575.827073:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947575.827201:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297893632 00000100:00100000:2.0:1783947575.827214:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297893632 00000100:00100000:2.0:1783947575.827450:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 135 00000100:00100000:2.0:1783947575.827465:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:10221:x1870604297893632:12345-192.168.203.32@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783947575.827619:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:10221:x1870604297893632:12345-192.168.203.32@tcp:60:lhsmtool_posix.0 Request processed in 158us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947575.827627:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 135 00000100:00080000:0.0:1783947575.828002:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947575.829865:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947575.830640:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297893888 00000100:00100000:0.0:1783947575.830679:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297893888 00000100:00100000:0.0:1783947575.830805:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:0.0:1783947575.830818:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:10221:x1870604297893888:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783947575.831695:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:10221:x1870604297893888:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 870us (1846us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1783947575.831707:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:3.0:1783947576.135618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947576.135805:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297894016 00000100:00100000:1.0:1783947576.135815:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297894016 00000100:00100000:1.0:1783947576.135901:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 136 00000100:00100000:1.0:1783947576.135913:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:11021:x1870604297894016:12345-192.168.203.32@tcp:101:lsof.0 00010000:00010000:1.0:1783947576.135933:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947576.135954:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb265b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab1b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947576.136017:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2662 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947576.136030:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947576.136042:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783947576.136059:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1783947576.136271:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783947576.136276:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783947576.136375:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947576.136400:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb265b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1b6 expref: 7 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947576.136661:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1b6 expref: 6 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947576.136670:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84af9a00) 00010000:00010000:1.0:1783947576.136674:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947576.136677:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73bc00, rc 0) 00000100:00100000:1.0:1783947576.136744:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+6:11021:x1870604297894016:12345-192.168.203.32@tcp:101:lsof.0 Request processed in 832us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947576.136752:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 136 00010000:00010000:1.0:1783947576.633552:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947577.658364:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783947578.008134:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1783947578.008436:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1783947578.008492:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1783947578.008504:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1783947578.136257:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947578.136371:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947578.136413:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947578.136500:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947578.136520:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947578.136732:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297894656 00000100:00100000:2.0:1783947578.136744:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297894656 00000100:00100000:2.0:1783947578.136848:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297894272 00000100:00100000:2.0:1783947578.136852:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297894272 00000100:00100000:2.0:1783947578.136872:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 156 00000100:00100000:2.0:1783947578.136881:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+6:2355:x1870604297894656:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947578.137019:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+6:2355:x1870604297894656:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 139us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947578.137027:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 156 00000100:00100000:2.0:1783947578.137076:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 157 00000100:00100000:2.0:1783947578.137083:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:2355:x1870604297894272:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947578.137109:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:2355:x1870604297894272:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 27us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947578.137115:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 157 00000100:00080000:2.0:1783947578.137153:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947578.145871:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297894400 00000100:00100000:3.0:1783947578.145887:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297894400 00000100:00100000:3.0:1783947578.146161:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297894528 00000100:00100000:3.0:1783947578.146165:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297894528 00000100:00080000:2.0:1783947578.146199:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783947578.146203:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947578.146239:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:2.0:1783947578.146251:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2355:x1870604297894400:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947578.146339:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2355:x1870604297894400:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 91us (9967us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947578.146347:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:3.0:1783947578.147289:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:3.0:1783947578.147302:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd85f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2355:x1870604297894528:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947578.147348:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd85f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2355:x1870604297894528:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 50us (10827us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947578.147355:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:0.0:1783947578.149819:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297894144 00000100:00100000:0.0:1783947578.149847:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297894144 00000100:00100000:3.0:1783947578.152681:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 295 00000100:00100000:3.0:1783947578.152734:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+13:2355:x1870604297894144:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947578.153016:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+13:2355:x1870604297894144:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 320us (16767us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947578.153026:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 295 00010000:00010000:1.0:1783947578.681692:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947579.450119:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319923456:0@lo:400:kworker.0 00000100:00100000:2.0:1783947579.450186:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947579.450253:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947579.450260:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319923584:0@lo:400:kworker.0 00000100:00100000:2.0:1783947579.450290:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947579.450327:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319923456 00000100:00100000:2.0:1783947579.450334:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319923456 00000100:00100000:2.0:1783947579.450387:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783947579.450397:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319923456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947579.450506:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319923456:12345-0@lo:400:kworker.0 Request processed in 112us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947579.450514:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783947579.450543:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319923584 00000100:00100000:2.0:1783947579.450546:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319923584 00000100:00100000:2.0:1783947579.450575:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783947579.450581:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319923584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947579.450617:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319923584:12345-0@lo:400:kworker.0 Request processed in 36us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947579.450624:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1783947579.450639:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783947579.450644:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947579.450676:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319923584:0@lo:400:kworker.0 00000100:00100000:2.0:1783947579.450686:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319923456:0@lo:400:kworker.0 00000100:00100000:3.0:1783947579.450854:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319923328:0@lo:400:kworker.0 00000100:00100000:3.0:1783947579.450882:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947579.450906:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319923840:0@lo:400:kworker.0 00000100:00100000:3.0:1783947579.450926:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947579.450943:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783947579.450948:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319923200:0@lo:400:kworker.0 00000100:00100000:3.0:1783947579.450973:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947579.450993:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b86507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319923712:0@lo:400:kworker.0 00000100:00100000:3.0:1783947579.451013:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947579.451166:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319923840 00000100:00100000:3.0:1783947579.451170:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319923840 00000100:00100000:3.0:1783947579.451204:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783947579.451210:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319923840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947579.451245:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319923840:12345-0@lo:400:kworker.0 Request processed in 36us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947579.451251:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783947579.451520:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319923328 00000100:00100000:2.0:1783947579.451524:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319923328 00000100:00100000:2.0:1783947579.451557:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319923712 00000100:00100000:2.0:1783947579.451560:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319923712 00000100:00100000:2.0:1783947579.451582:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783947579.451588:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319923328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947579.451621:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319923328:12345-0@lo:400:kworker.0 Request processed in 33us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947579.451627:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783947579.451640:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783947579.451646:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319923712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947579.451672:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319923712:12345-0@lo:400:kworker.0 Request processed in 27us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947579.451687:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783947579.451706:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319923200 00000100:00100000:2.0:1783947579.451709:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319923200 00000100:00100000:2.0:1783947579.451732:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1783947579.451751:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319923200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947579.451783:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319923200:12345-0@lo:400:kworker.0 Request processed in 33us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947579.451789:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:2.0:1783947579.451818:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783947579.451822:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783947579.452581:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947579.452596:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319923968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947579.452634:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947579.452667:0:11568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319923968 00000100:00100000:0.0:1783947579.452671:0:11568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319923968 00000100:00100000:0.0:1783947579.452704:0:11568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783947579.452712:0:11568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319923968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947579.452752:0:11568:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947579.452801:0:11568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319923968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947579.452808:0:11568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783947579.452849:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319923968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947579.455243:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319923200:0@lo:400:kworker.0 00000100:00100000:1.0:1783947579.455266:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319923712:0@lo:400:kworker.0 00000100:00100000:1.0:1783947579.455297:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319923328:0@lo:400:kworker.0 00000100:00100000:1.0:1783947579.455308:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b86504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319923840:0@lo:400:kworker.0 00010000:00010000:2.0:1783947579.710917:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783947579.916918:0:12176:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:59:37 (1783947577) 00000100:00100000:2.0:1783947579.963479:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb65dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319924096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947579.963560:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947579.963735:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319924096 00000100:00100000:0.0:1783947579.963751:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319924096 00000100:00100000:0.0:1783947579.963803:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783947579.963813:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319924096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783947579.963847:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947579.963894:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319924096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947579.963901:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783947579.963914:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb65dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319924096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783947580.729717:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947581.422762:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947581.422852:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297894912 00000100:00100000:1.0:1783947581.422862:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297894912 00000100:00100000:1.0:1783947581.423215:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 137 00000100:00100000:1.0:1783947581.423227:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:11286:x1870604297894912:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947581.423248:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947581.423269:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2669 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab1bd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.423344:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2670 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.423359:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2670 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.423372:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2670 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.423474:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2677 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.423483:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2677 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.423489:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2677 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.423945:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb267e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.423955:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb267e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.423962:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb267e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947581.423972:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1783947581.424188:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2670 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.424196:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2670 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.424202:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2670 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.424208:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947581.424212:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2670 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.424220:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2670 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.424232:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b3c82977300) 00010000:00010000:1.0:1783947581.424235:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947581.424239:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2670 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.424256:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2670 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.424270:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2677 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.424276:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2677 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.424281:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2677 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.424285:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947581.424288:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2677 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.424294:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2677 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.424302:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8b3c82977500) 00010000:00010000:1.0:1783947581.424305:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947581.424307:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2677 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.424313:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb2677 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.424789:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2669 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1bd expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.424807:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb267e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1bd expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947581.424823:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b3c84bc6300) 00010000:00010000:1.0:1783947581.424826:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947581.424829:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73b400, rc 0) 00000100:00100000:1.0:1783947581.424904:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+15:11286:x1870604297894912:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 1678us (2162us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1783947581.424913:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 137 00000100:00080000:2.0:1783947581.424984:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947581.443227:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947581.443309:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947581.444603:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297895168 00000100:00100000:3.0:1783947581.444621:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297895168 00000100:00100000:3.0:1783947581.444739:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:3.0:1783947581.444752:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c856ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+15:2354:x1870604297895168:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947581.444773:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947581.446007:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb267e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1bd expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947581.446073:0:8318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b3c84bc6300) 00010000:00010000:3.0:1783947581.446080:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947581.446174:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c856ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:2354:x1870604297895168:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 1424us (2862us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947581.446195:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:0.0:1783947581.446847:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297895040 00000100:00100000:0.0:1783947581.446859:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297895040 00000100:00100000:0.0:1783947581.446922:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 138 00000100:00100000:0.0:1783947581.446931:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:11286:x1870604297895040:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783947581.447229:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:11286:x1870604297895040:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 Request processed in 299us (4019us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947581.447239:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 138 00010000:00010000:2.0:1783947581.753852:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783947581.818108:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783947581.818124:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783947581.818680:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1783947581.818692:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783947582.779687:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783947583.111456:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:2.0:1783947583.239170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947583.239327:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947583.239362:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947583.239391:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947583.239445:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947583.239511:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297895296 00000100:00100000:3.0:1783947583.239525:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297895296 00000100:00100000:3.0:1783947583.239590:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 297 00000100:00100000:3.0:1783947583.239602:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:2355:x1870604297895296:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947583.239706:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:2355:x1870604297895296:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 107us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947583.239715:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 297 00000100:00100000:0.0:1783947583.240518:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297895680 00000100:00100000:0.0:1783947583.240527:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297895680 00000100:00100000:0.0:1783947583.240585:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297895552 00000100:00100000:0.0:1783947583.240588:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297895552 00000100:00100000:0.0:1783947583.240618:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 72 00000100:00100000:0.0:1783947583.240627:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2355:x1870604297895680:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947583.240697:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2355:x1870604297895680:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 72us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947583.240721:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 72 00000100:00100000:0.0:1783947583.240739:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00100000:0.0:1783947583.240745:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2355:x1870604297895552:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947583.240773:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2355:x1870604297895552:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 28us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947583.240780:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00080000:0.0:1783947583.240802:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783947583.240807:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947583.251116:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297895424 00000100:00100000:1.0:1783947583.251140:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297895424 00000100:00080000:1.0:1783947583.251199:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947583.251279:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297895808 00000100:00100000:1.0:1783947583.251284:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297895808 00000100:00100000:1.0:1783947583.251325:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 161 00000100:00100000:1.0:1783947583.251337:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:2355:x1870604297895424:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947583.251467:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:2355:x1870604297895424:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 132us (12311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947583.251477:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 161 00000100:00100000:1.0:1783947583.251500:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 162 00000100:00100000:1.0:1783947583.251508:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+6:2355:x1870604297895808:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947583.251535:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+6:2355:x1870604297895808:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 28us (12090us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947583.251541:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 162 00000100:00080000:1.0:1783947583.251561:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947583.753823:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947583.753955:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297895936 00000100:00100000:1.0:1783947583.753969:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297895936 00000100:00100000:1.0:1783947583.754074:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 139 00000100:00100000:1.0:1783947583.754087:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:11328:x1870604297895936:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1783947583.754115:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947583.754144:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb268c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab1c4 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754230:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2693 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754248:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2693 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754264:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2693 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754281:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb269a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754289:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb269a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754296:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb269a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754756:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2693 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754767:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2693 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754774:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2693 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754792:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947583.754798:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2693 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754806:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2693 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754821:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84af9a00) 00010000:00010000:1.0:1783947583.754825:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947583.754831:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2693 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754837:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2693 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754852:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb269a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754858:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb269a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754865:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb269a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754870:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947583.754873:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb269a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754880:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb269a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754897:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8b3c82977500) 00010000:00010000:1.0:1783947583.754900:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947583.754903:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb269a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754910:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb269a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754957:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb268c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1c4 expref: 14 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754970:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84af9a00) 00010000:00010000:1.0:1783947583.754972:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947583.754976:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb268c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1c4 expref: 14 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.754986:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a400, rc 0) 00000100:00100000:1.0:1783947583.755296:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:11328:x1870604297895936:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1210us (1489us total) trans 0 rc 301/301 00000100:00100000:1.0:1783947583.755306:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 139 00000100:00100000:1.0:1783947583.768978:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947583.769073:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297896192 00000100:00100000:3.0:1783947583.769086:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297896192 00000100:00100000:3.0:1783947583.769162:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 140 00000100:00100000:3.0:1783947583.769182:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:11328:x1870604297896192:12345-192.168.203.32@tcp:36:lfs.0 00010000:00010000:3.0:1783947583.769258:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947583.769293:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb200a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaffd expref: 13 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947583.769326:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84af9a00) 00010000:00010000:3.0:1783947583.769332:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947583.769707:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb26a1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947583.769737:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2662 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1b6 expref: 5 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947583.769747:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb26a1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947583.769791:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1b6 expref: 5 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947583.769809:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2662 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1b6 expref: 5 pid: 5798 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947583.769827:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5795:1870604319924224:192.168.203.32@tcp:104: 00000100:00100000:3.0:1783947583.769952:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb66f2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783947583.781640:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5795:1870604319924224:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947583.781681:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb26a1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947583.786775:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947583.786894:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297896320 00000100:00100000:0.0:1783947583.786907:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297896320 00010000:00010000:0.0:1783947583.786966:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2662 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1b6 expref: 6 pid: 5798 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947583.787030:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:0.0:1783947583.787042:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+6:2354:x1870604297896320:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947583.787062:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947583.787070:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2662 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1b6 expref: 6 pid: 5798 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947583.787085:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1b6 expref: 6 pid: 5798 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947583.787113:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2662 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1b6 expref: 6 pid: 5798 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947583.787156:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84af9a00) 00010000:00010000:0.0:1783947583.787162:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb26a1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947583.787173:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb26a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947583.787182:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb26a1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947583.787210:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947583.787276:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2354:x1870604297896320:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 236us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947583.787284:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 59 00010000:00010000:3.0:1783947583.792024:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb26a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947583.792046:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb26a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947583.792085:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb26a8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947583.792123:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb26a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947583.792136:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb26a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947583.793529:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1783947583.793550:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb26a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947583.793560:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb26a1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947583.793567:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb26a1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947583.793573:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947583.793579:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb26a1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947583.793587:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb26a1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947583.793605:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c84af9a00) 00010000:00010000:3.0:1783947583.793607:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947583.793613:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb26a1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947583.793620:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb26a1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783947583.793658:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039a25bf5 reply state 00000000a22cf96b transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb26a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947583.793668:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783947583.793797:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:11328:x1870604297896192:12345-192.168.203.32@tcp:36:lfs.0 Request processed in 24620us (24828us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1783947583.793807:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 140 00010000:00010000:2.0:1783947583.805668:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb26a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947583.805715:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb26a8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947583.805724:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb26a8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947583.805730:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1ba00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947583.805737:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb26a8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947583.805746:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb26a8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947583.805768:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8b3c84af9b00) 00010000:00010000:2.0:1783947583.805772:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947583.805778:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb26a8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947583.805785:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb26a8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947583.810628:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947583.928529:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947583.928730:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297896448 00000100:00100000:1.0:1783947583.928745:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297896448 00000100:00100000:1.0:1783947583.928832:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 141 00000100:00100000:1.0:1783947583.928845:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+13:11336:x1870604297896448:12345-192.168.203.32@tcp:101:lctl.0 00010000:00010000:1.0:1783947583.928879:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947583.928911:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb26af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab1cb expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.929032:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb26b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.929049:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb26b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.929063:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb26b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947583.929146:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783947583.929150:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1783947583.929182:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb26b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.929211:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb26af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1cb expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.929233:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb26b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1cb expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947583.929243:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c82977500) 00010000:00010000:1.0:1783947583.929246:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947583.929251:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73b000, rc 0) 00000100:00100000:1.0:1783947583.929812:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:11336:x1870604297896448:12345-192.168.203.32@tcp:101:lctl.0 Request processed in 964us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947583.929822:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 141 00000100:00100000:3.0:1783947584.014234:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947584.014468:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297896576 00000100:00100000:1.0:1783947584.014481:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297896576 00000100:00100000:1.0:1783947584.014581:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 142 00000100:00100000:1.0:1783947584.014593:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+14:11342:x1870604297896576:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1783947584.014620:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947584.014648:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb26bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab1d2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.014735:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb26c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.014755:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb26c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.014768:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb26c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.014783:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.014790:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.014797:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.014941:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb26d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.014949:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb26d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.014956:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb26d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947584.015019:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1783947584.015024:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783947584.015053:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb26d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.015073:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb26c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.015080:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb26c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.015087:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb26c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.015093:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947584.015098:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb26c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.015107:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb26c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.015122:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c82977500) 00010000:00010000:1.0:1783947584.015125:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947584.015135:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb26c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.015141:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb26c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.015158:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.015239:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.015245:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.015249:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947584.015252:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.015258:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.015266:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8b3c82977600) 00010000:00010000:1.0:1783947584.015268:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947584.015271:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.015277:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.015327:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb26bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1d2 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.015343:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb26d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1d2 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.015350:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:1.0:1783947584.015353:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783947584.015361:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a200, rc 0) 00000100:00100000:1.0:1783947584.015508:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+15:11342:x1870604297896576:12345-192.168.203.32@tcp:101:bash.0 Request processed in 916us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947584.015517:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 142 00000100:00100000:3.0:1783947584.020303:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947584.020597:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297896832 00000100:00100000:1.0:1783947584.020609:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297896832 00000100:00100000:1.0:1783947584.020687:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 143 00000100:00100000:1.0:1783947584.020699:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+15:11342:x1870604297896832:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1783947584.020724:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947584.020749:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb26d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab1d9 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.020916:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb26e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.020933:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb26e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.020946:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb26e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.024652:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb26e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.024677:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb26e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.024700:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb26e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783947584.025531:0:6613:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1783947584.025724:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.025737:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.025746:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.025781:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb26e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.025788:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb26e0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.025794:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb26e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.025800:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947584.025804:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb26e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.025812:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb26e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.025824:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:1.0:1783947584.025828:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947584.025832:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb26e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.025839:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb26e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947584.025863:0:6613:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001b531a87 reply state 000000002b7fbe33 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb26e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947584.025872:0:6613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783947584.025916:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb26d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1d9 expref: 18 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.025931:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1d9 expref: 17 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.025939:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c82977900) 00010000:00010000:1.0:1783947584.025941:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947584.025944:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a800, rc 0) 00000100:00100000:1.0:1783947584.026047:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:11342:x1870604297896832:12345-192.168.203.32@tcp:101:bash.0 Request processed in 5349us (5757us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1783947584.026057:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 143 00010000:00010000:1.0:1783947584.027828:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb26e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.027843:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb26e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.027851:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb26e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.027857:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947584.027882:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb26e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.027909:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb26e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.027924:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b3c82977600) 00010000:00010000:1.0:1783947584.027927:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947584.027931:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb26e7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.027938:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb26e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947584.032092:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947584.032623:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297896960 00000100:00100000:0.0:1783947584.032637:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297896960 00000100:00100000:0.0:1783947584.032723:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:0.0:1783947584.032735:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2356:x1870604297896960:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1783947584.032758:0:8151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947584.032784:0:8151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009509ce4f/0x20c3e53e78bb26fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab1e0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783947584.032815:0:8151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783947584.032841:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=399s v=(0 0) 00010000:00010000:0.0:1783947584.032846:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947584.032857:0:8151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009509ce4f/0x20c3e53e78bb26fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e0 expref: 6 pid: 8151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.032902:0:8151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009509ce4f/0x20c3e53e78bb26fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e0 expref: 6 pid: 8151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.032918:0:8151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671800, rc 0) 00000100:00100000:0.0:1783947584.032991:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2356:x1870604297896960:12345-192.168.203.32@tcp:101:bash.0 Request processed in 258us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947584.032998:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:3.0:1783947584.045330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947584.045659:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297897088 00000100:00100000:0.0:1783947584.045673:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297897088 00000100:00100000:0.0:1783947584.045744:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:0.0:1783947584.045755:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:11342:x1870604297897088:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1783947584.045778:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947584.045802:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecec1c64/0x20c3e53e78bb2703 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab1e7 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.045845:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009509ce4f/0x20c3e53e78bb26fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e0 expref: 7 pid: 8151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.045856:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947584.045860:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947584.045865:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecec1c64/0x20c3e53e78bb2703 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e7 expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.045906:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009509ce4f/0x20c3e53e78bb26fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e0 expref: 7 pid: 8151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.045939:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009509ce4f/0x20c3e53e78bb26fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e0 expref: 7 pid: 8151 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947584.045956:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1870604319924352:192.168.203.32@tcp:104: 00000100:00100000:0.0:1783947584.046102:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c81377cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947584.051905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947584.052459:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297897216 00000100:00100000:2.0:1783947584.052471:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297897216 00010000:00010000:2.0:1783947584.052538:0:8318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009509ce4f/0x20c3e53e78bb26fc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e0 expref: 8 pid: 8151 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947584.052595:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:2.0:1783947584.052606:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2353:x1870604297897216:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947584.052647:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947584.052679:0:8318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009509ce4f/0x20c3e53e78bb26fc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e0 expref: 8 pid: 8151 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947584.052695:0:8318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009509ce4f/0x20c3e53e78bb26fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e0 expref: 8 pid: 8151 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947584.052729:0:8318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947584.052735:0:8318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947584.052746:0:8318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecec1c64/0x20c3e53e78bb2703 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e7 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947584.052758:0:8318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecec1c64/0x20c3e53e78bb2703 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e7 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947584.052814:0:8318:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ecec1c64/0x20c3e53e78bb2703 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e7 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947584.052831:0:8318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd443100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8318:1870604319924480:192.168.203.32@tcp:105: 00000100:00100000:2.0:1783947584.052950:0:8318:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432f6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1783947584.053509:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009509ce4f/0x20c3e53e78bb26fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e0 expref: 8 pid: 8151 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947584.053533:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1870604319924352:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947584.053566:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ecec1c64/0x20c3e53e78bb2703 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e7 expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.053578:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670e00, rc 0) 00000100:00100000:3.0:1783947584.053620:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:11342:x1870604297897088:12345-192.168.203.32@tcp:101:bash.0 Request processed in 7867us (8318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947584.053629:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:0.0:1783947584.056049:0:8318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd443100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8318:1870604319924480:192.168.203.32@tcp:105: 00010000:00010000:0.0:1783947584.056080:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947584.056144:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2353:x1870604297897216:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 3539us (4253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947584.056158:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:1.0:1783947584.065333:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947584.065632:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297897472 00000100:00100000:0.0:1783947584.065646:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297897472 00000100:00100000:0.0:1783947584.065753:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:0.0:1783947584.065766:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+17:11342:x1870604297897472:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:0.0:1783947584.066276:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:11342:x1870604297897472:12345-192.168.203.32@tcp:35:bash.0 Request processed in 510us (955us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1783947584.066287:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:3.0:1783947584.190878:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947584.191309:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297897728 00000100:00100000:1.0:1783947584.191325:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297897728 00000100:00100000:1.0:1783947584.191453:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 144 00000100:00100000:1.0:1783947584.191466:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:11352:x1870604297897728:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1783947584.191500:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947584.191529:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb270a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab1ee expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947584.191718:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1783947584.192385:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb270a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1ee expref: 20 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.192405:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c82977500) 00010000:00010000:1.0:1783947584.192408:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947584.192414:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb270a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1ee expref: 20 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.192678:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a600, rc 0) 00000100:00100000:1.0:1783947584.192842:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:11352:x1870604297897728:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1376us (1986us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1783947584.192853:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 144 00000100:00100000:2.0:1783947584.201625:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947584.201723:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297897984 00000100:00100000:3.0:1783947584.201756:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297897984 00000100:00100000:3.0:1783947584.202142:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:3.0:1783947584.202155:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:11352:x1870604297897984:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1783947584.203462:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+20:11352:x1870604297897984:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 1298us (1842us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1783947584.203476:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:2.0:1783947584.282608:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947584.282726:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297898112 00000100:00100000:3.0:1783947584.282736:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297898112 00000100:00100000:3.0:1783947584.282912:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 145 00000100:00100000:3.0:1783947584.282923:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+20:11358:x1870604297898112:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1783947584.282947:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947584.282968:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2718 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab1f5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.283044:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb271f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.283058:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb271f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.283068:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb271f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947584.283126:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1783947584.283129:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947584.283166:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb271f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.283192:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2718 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1f5 expref: 22 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.283231:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb271f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1f5 expref: 21 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.283240:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:3.0:1783947584.283244:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947584.283247:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a400, rc 0) 00000100:00100000:3.0:1783947584.283308:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:11358:x1870604297898112:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 387us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947584.283316:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 145 00000100:00100000:1.0:1783947584.288604:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947584.288688:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297898368 00000100:00100000:3.0:1783947584.288697:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297898368 00000100:00100000:3.0:1783947584.288753:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 146 00000100:00100000:3.0:1783947584.288764:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:11358:x1870604297898368:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1783947584.288785:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947584.288815:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2726 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab1fc expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.288915:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb272d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.288928:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb272d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.288939:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb272d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947584.288950:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783947584.289095:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2726 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1fc expref: 24 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.289111:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb272d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1fc expref: 23 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.289120:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c82977900) 00010000:00010000:3.0:1783947584.289123:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947584.289126:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a000, rc 0) 00000100:00100000:3.0:1783947584.289191:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:11358:x1870604297898368:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 429us (597us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1783947584.289199:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 146 00000100:00100000:2.0:1783947584.293520:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947584.293770:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297898624 00000100:00100000:1.0:1783947584.293780:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297898624 00000100:00100000:1.0:1783947584.293839:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 147 00000100:00100000:1.0:1783947584.293849:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:11358:x1870604297898624:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1783947584.293875:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947584.293896:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb273b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab203 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.293989:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2742 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.294003:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.294025:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947584.294037:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783947584.294156:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb273b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab203 expref: 26 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.294635:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2742 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab203 expref: 25 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.294660:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c82977900) 00010000:00010000:1.0:1783947584.294663:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783947584.294667:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73b400, rc 0) 00000100:00100000:1.0:1783947584.294733:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+25:11358:x1870604297898624:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 884us (1220us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1783947584.294741:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 147 00000100:00100000:2.0:1783947584.300526:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947584.300632:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297898752 00000100:00100000:0.0:1783947584.300643:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297898752 00000100:00100000:0.0:1783947584.300712:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1783947584.300722:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83371880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+25:2354:x1870604297898752:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947584.300738:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947584.300783:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb272d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1fc expref: 25 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.300800:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c82977900) 00010000:00010000:0.0:1783947584.300806:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947584.300863:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83371880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:2354:x1870604297898752:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 142us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947584.300871:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:3.0:1783947584.307851:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947584.308332:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297898880 00000100:00100000:0.0:1783947584.308344:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297898880 00000100:00100000:0.0:1783947584.308405:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:0.0:1783947584.308415:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2356:x1870604297898880:12345-192.168.203.32@tcp:1:lfs.0 00010000:00010000:0.0:1783947584.308582:0:8151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2750 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.308603:0:8151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecec1c64/0x20c3e53e78bb2703 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e7 expref: 6 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.308612:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947584.308617:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783947584.308621:0:8151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2750 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.308656:0:8151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ecec1c64/0x20c3e53e78bb2703 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e7 expref: 6 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.308671:0:8151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ecec1c64/0x20c3e53e78bb2703 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e7 expref: 6 pid: 6592 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947584.308703:0:8151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8151:1870604319924608:192.168.203.32@tcp:104: 00000100:00100000:0.0:1783947584.308874:0:8151:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c813770c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947584.316387:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947584.316570:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297899008 00000100:00100000:2.0:1783947584.316580:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297899008 00002000:00100000:2.0:1783947584.316652:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8b3c83374000 x1870604297899008/t0(0) o4->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:375/0 lens 504/0 e 0 to 0 dl 1783947595 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783947584.316664:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3c83374000 with x1870604297899008 ext(0->12) 00010000:00010000:2.0:1783947584.316673:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ecec1c64/0x20c3e53e78bb2703 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e7 expref: 7 pid: 6592 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947584.316690:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ecec1c64/0x20c3e53e78bb2703 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e7 expref: 7 pid: 6592 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783947584.316698:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b3c83374000 00000100:00100000:2.0:1783947584.316724:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:2.0:1783947584.316734:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2353:x1870604297899008:12345-192.168.203.32@tcp:4:lfs.0 00000100:00100000:2.0:1783947584.317251:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2353:x1870604297899008:12345-192.168.203.32@tcp:4:lfs.0 Request processed in 516us (872us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1783947584.317259:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00002000:00100000:2.0:1783947584.317266:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8b3c83374000 x1870604297899008/t4294967305(0) o4->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:375/0 lens 504/448 e 0 to 0 dl 1783947595 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783947584.317275:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3c83374000 with x1870604297899008 ext(0->12) 00010000:00010000:2.0:1783947584.317281:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ecec1c64/0x20c3e53e78bb2703 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e7 expref: 9 pid: 6592 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947584.317294:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ecec1c64/0x20c3e53e78bb2703 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e7 expref: 9 pid: 6592 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783947584.317301:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b3c83374000 00000100:00100000:0.0:1783947584.320340:0:8151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8151:1870604319924608:192.168.203.32@tcp:104: 00010000:00010000:0.0:1783947584.320371:0:8151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2750 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947584.321563:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947584.321654:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297899136 00000100:00100000:0.0:1783947584.321664:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297899136 00010000:00010000:0.0:1783947584.321705:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ecec1c64/0x20c3e53e78bb2703 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e7 expref: 9 pid: 6592 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947584.321749:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:0.0:1783947584.321759:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83372300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2354:x1870604297899136:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947584.321777:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783947584.321894:0:5784:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783947584.321898:0:5784:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783947583 00002000:00010000:0.0:1783947584.321900:0:5784:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783947583 00002000:00010000:0.0:1783947584.321902:0:5784:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1783947583 00010000:00010000:0.0:1783947584.321909:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ecec1c64/0x20c3e53e78bb2703 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e7 expref: 9 pid: 6592 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.321924:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ecec1c64/0x20c3e53e78bb2703 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e7 expref: 9 pid: 6592 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.322046:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecec1c64/0x20c3e53e78bb2703 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1e7 expref: 9 pid: 6592 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.322069:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783947584.322074:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783947584.322079:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2750 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.322089:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2750 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.322120:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947584.322294:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83372300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2354:x1870604297899136:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 535us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947584.322303:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 61 00010000:00010000:2.0:1783947584.322373:0:8151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2750 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947584.322383:0:8151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2750 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947584.322408:0:8151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2750 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947584.322449:0:8151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2750 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947584.322457:0:8151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2750 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947584.322464:0:8151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671e00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:2.0:1783947584.322469:0:8151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2750 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947584.322477:0:8151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2750 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947584.322489:0:8151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2750 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947584.322497:0:8151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2750 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947584.322552:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2356:x1870604297898880:12345-192.168.203.32@tcp:1:lfs.0 Request processed in 14139us (14711us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947584.322561:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:3.0:1783947584.326591:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947584.326676:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297899392 00000100:00100000:0.0:1783947584.326686:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297899392 00000100:00100000:0.0:1783947584.326744:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:0.0:1783947584.326754:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85b9b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:11358:x1870604297899392:12345-192.168.203.32@tcp:35:lfs.0 00000004:00010000:0.0:1783947584.326825:0:5799:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2742 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab203 expref: 24 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783947584.327085:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1783947584.327126:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1783947584.327728:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1783947584.327787:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2757 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.327810:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1d9 expref: 28 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.327819:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2757 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.327853:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1d9 expref: 28 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.327866:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1d9 expref: 28 pid: 6613 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947584.327880:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1870604319924736:192.168.203.32@tcp:104: 00000100:00100000:0.0:1783947584.327959:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c813770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947584.332703:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1870604319924736:192.168.203.32@tcp:104: 00010000:00010000:0.0:1783947584.332730:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2757 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947584.339943:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947584.340624:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297899520 00000100:00100000:0.0:1783947584.340634:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297899520 00010000:00010000:0.0:1783947584.340675:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1d9 expref: 29 pid: 6613 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947584.340717:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:0.0:1783947584.340727:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+29:2354:x1870604297899520:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947584.340743:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947584.340762:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1d9 expref: 29 pid: 6613 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.340773:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1d9 expref: 29 pid: 6613 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.340805:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb26ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1d9 expref: 29 pid: 6613 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.340823:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c82977900) 00010000:00010000:0.0:1783947584.340828:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2757 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.340838:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2757 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.340846:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2757 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.340880:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947584.340936:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+28:2354:x1870604297899520:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 210us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947584.340944:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 62 00010000:00010000:1.0:1783947584.341543:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2757 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.341552:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2757 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783947584.341672:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1783947584.341868:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1783947584.341969:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1870604319924864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783947584.342033:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947584.342064:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad698540 going to sleep for 11 seconds 00000100:00100000:0.0:1783947584.342606:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319924864 00000100:00100000:0.0:1783947584.342614:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319924864 00000100:00100000:0.0:1783947584.342675:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783947584.342686:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5799:x1870604319924864:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783947584.342767:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5799:x1870604319924864:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947584.342791:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1783947584.344125:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947584.344193:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1870604319924864:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1783947584.344730:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1783947584.344970:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c812a9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1870604319924992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783947584.345039:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947584.345071:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad698900 going to sleep for 11 seconds 00000100:00100000:0.0:1783947584.347155:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319924992 00000100:00100000:0.0:1783947584.347176:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319924992 00000100:00100000:0.0:1783947584.347241:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783947584.347252:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5799:x1870604319924992:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783947584.347545:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5799:x1870604319924992:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 295us (2505us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783947584.347553:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783947584.348216:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c812a9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1870604319924992:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1783947584.348295:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1783947584.348358:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2757 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.348385:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2757 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.348392:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2757 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.348399:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947584.348404:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2757 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.348413:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2757 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.348451:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c82977900) 00010000:00010000:1.0:1783947584.348454:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783947584.348458:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2757 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.348465:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2757 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783947584.348667:0:5799:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783947584.348829:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1783947584.348840:0:5799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399619421459ns, next at 400619419444ns, rc = 0 00000001:00080000:1.0:1783947584.348847:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1783947584.348879:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c82977900) 00010000:00010000:1.0:1783947584.348882:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783947584.348889:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2742 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab203 expref: 32 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947584.349256:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85b9b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+31:11358:x1870604297899392:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 22502us (22672us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1783947584.349268:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 38 00000020:00080000:1.0:1783947584.349274:0:5799:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783947584.355247:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947584.355354:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297899648 00000100:00100000:0.0:1783947584.355364:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297899648 00000100:00100000:0.0:1783947584.355455:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 148 00000100:00100000:0.0:1783947584.355465:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+31:11358:x1870604297899648:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1783947584.355488:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947584.355511:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb275e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab20a expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.355568:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb275e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab20a expref: 32 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.355583:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb275e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab20a expref: 32 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.355601:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:0.0:1783947584.355604:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947584.355608:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670e00, rc 0) 00000100:00100000:0.0:1783947584.355657:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+32:11358:x1870604297899648:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 193us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947584.355678:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 148 00000100:00100000:2.0:1783947584.363212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947584.363536:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297899904 00000100:00100000:1.0:1783947584.363546:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297899904 00000100:00100000:1.0:1783947584.363608:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:1.0:1783947584.363618:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+32:11358:x1870604297899904:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1783947584.363871:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+33:11358:x1870604297899904:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 253us (668us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1783947584.363879:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:2.0:1783947584.546452:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947584.546540:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297900160 00000100:00100000:3.0:1783947584.546549:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297900160 00000100:00100000:3.0:1783947584.546605:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 149 00000100:00100000:3.0:1783947584.546617:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+33:11368:x1870604297900160:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1783947584.546639:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947584.546658:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb2765 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab211 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947584.546770:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1783947584.546895:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb2765 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab211 expref: 35 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.546926:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c82977500) 00010000:00010000:3.0:1783947584.546929:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783947584.546934:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb2765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab211 expref: 35 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.546947:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1ae00, rc 0) 00000100:00100000:3.0:1783947584.547013:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+34:11368:x1870604297900160:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 390us (595us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1783947584.547021:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 149 00000100:00100000:3.0:1783947584.552193:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947584.552283:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297900288 00000100:00100000:0.0:1783947584.552293:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297900288 00000100:00100000:0.0:1783947584.552367:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 150 00000100:00100000:0.0:1783947584.552378:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+34:11368:x1870604297900288:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:0.0:1783947584.552508:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb2773 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552525:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb2773 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552538:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb2773 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552555:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb277a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552562:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb277a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552570:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb277a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552667:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2781 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552676:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552683:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947584.552746:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552759:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb2773 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552766:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb2773 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552773:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb2773 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552779:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947584.552784:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb2773 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552792:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb2773 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552804:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:0.0:1783947584.552807:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947584.552811:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb2773 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552818:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb2773 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552834:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb277a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552839:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb277a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552851:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb277a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552856:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947584.552859:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb277a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552865:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb277a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552873:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b3c8281b500) 00010000:00010000:0.0:1783947584.552875:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947584.552879:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb277a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552884:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb277a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552899:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552905:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2781 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552911:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2781 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552916:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947584.552919:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2781 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552935:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2781 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552943:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:0.0:1783947584.552945:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947584.552948:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2781 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.552954:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb2781 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947584.553046:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+34:11368:x1870604297900288:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 669us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947584.553054:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 150 00000100:00100000:2.0:1783947584.557355:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947584.557543:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297900544 00000100:00100000:1.0:1783947584.557553:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297900544 00000100:00100000:1.0:1783947584.557607:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:1.0:1783947584.557616:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+34:11368:x1870604297900544:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1783947584.557886:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+35:11368:x1870604297900544:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 270us (538us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1783947584.557894:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:3.0:1783947584.569672:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947584.569697:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319925120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947584.569766:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947584.569896:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319925120 00000100:00100000:0.0:1783947584.569904:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319925120 00000100:00100000:0.0:1783947584.569954:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783947584.569964:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c8797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1870604319925120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947584.569987:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947584.570052:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c8797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1870604319925120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947584.570060:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783947584.570149:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319925120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947584.570622:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c8797b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319925504:0@lo:400:kworker.0 00000100:00100000:3.0:1783947584.570652:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947584.570671:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947584.570677:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c87978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870604319925376:0@lo:400:kworker.0 00000100:00100000:3.0:1783947584.570696:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947584.570722:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319925504 00000100:00100000:3.0:1783947584.570726:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319925504 00000100:00100000:3.0:1783947584.570759:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319925376 00000100:00100000:3.0:1783947584.570762:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319925376 00000100:00100000:3.0:1783947584.570779:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783947584.570785:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319925504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947584.570849:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319925504:12345-0@lo:400:kworker.0 Request processed in 64us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947584.570856:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783947584.570869:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783947584.570875:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870604319925376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947584.570899:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870604319925376:12345-0@lo:400:kworker.0 Request processed in 24us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947584.570905:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783947584.570932:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c87978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870604319925376:0@lo:400:kworker.0 00000100:00100000:3.0:1783947584.570941:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c8797b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319925504:0@lo:400:kworker.0 00000100:00100000:0.0:1783947584.571268:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c87978700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319925248:0@lo:400:kworker.0 00000100:00100000:0.0:1783947584.571302:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947584.571345:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319925760:0@lo:400:kworker.0 00000100:00100000:0.0:1783947584.571368:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947584.571394:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947584.571410:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c87979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319925632:0@lo:400:kworker.0 00000100:00100000:0.0:1783947584.571452:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947584.571579:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319925760 00000100:00100000:2.0:1783947584.571584:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319925760 00000100:00100000:2.0:1783947584.571625:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783947584.571633:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319925760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947584.571676:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319925760:12345-0@lo:400:kworker.0 Request processed in 44us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947584.571682:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783947584.571710:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319925760:0@lo:400:kworker.0 00000100:00100000:3.0:1783947584.571773:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319925248 00000100:00100000:3.0:1783947584.571777:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319925248 00000100:00100000:3.0:1783947584.571827:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1783947584.571834:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319925248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947584.571870:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3312:x1870604319925248:12345-0@lo:400:kworker.0 Request processed in 37us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947584.571876:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1783947584.571906:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c87978700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319925248:0@lo:400:kworker.0 00000100:00100000:3.0:1783947584.571921:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319925632 00000100:00100000:3.0:1783947584.571925:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319925632 00000100:00100000:3.0:1783947584.571947:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783947584.571953:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319925632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947584.571981:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870604319925632:12345-0@lo:400:kworker.0 Request processed in 28us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947584.571996:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783947584.572035:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c87979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1870604319925632:0@lo:400:kworker.0 00000100:00080000:0.0:1783947584.573804:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783947584.573815:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947584.631507:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947584.631572:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297900800 00000100:00100000:3.0:1783947584.631580:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297900800 00000100:00100000:3.0:1783947584.631640:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 151 00000100:00100000:3.0:1783947584.631650:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+35:11371:x1870604297900800:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1783947584.631674:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947584.631695:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb2788 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab218 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.631768:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb278f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.631781:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb278f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.631803:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb278f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.631817:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2796 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.631824:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.631831:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.631948:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb279d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.631965:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb279d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.631970:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb279d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947584.631977:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783947584.632085:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb278f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.632092:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb278f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.632098:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb278f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.632104:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947584.632108:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb278f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.632115:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb278f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.632126:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:3.0:1783947584.632129:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947584.632133:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb278f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.632139:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb278f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.632151:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.633991:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2796 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.634000:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.634016:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947584.634021:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.634029:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2796 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.634045:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b3c84af9a00) 00010000:00010000:3.0:1783947584.634048:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947584.634052:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2796 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.634058:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2796 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.634133:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb2788 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab218 expref: 38 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.634147:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb279d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab218 expref: 37 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.634156:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:3.0:1783947584.634158:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947584.634185:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1ba00, rc 0) 00000100:00100000:3.0:1783947584.634262:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+37:11371:x1870604297900800:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 2611us (2759us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1783947584.634270:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 151 00000100:00100000:3.0:1783947584.637916:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947584.638019:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297900928 00000100:00100000:1.0:1783947584.638029:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297900928 00000100:00100000:1.0:1783947584.638093:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 152 00000100:00100000:1.0:1783947584.638104:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+37:11371:x1870604297900928:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:1.0:1783947584.638183:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb27ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.638218:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb27ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.638229:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb27ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.638255:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb27ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.638262:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb27ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.638269:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb27ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.638275:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947584.638279:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb27ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.638286:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb27ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.638296:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:1.0:1783947584.638299:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947584.638303:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb27ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.638309:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb27ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947584.638379:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+37:11371:x1870604297900928:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 277us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947584.638392:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 152 00000100:00100000:1.0:1783947584.641311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947584.641384:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297901184 00000100:00100000:0.0:1783947584.641394:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297901184 00000100:00100000:0.0:1783947584.641471:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:0.0:1783947584.641480:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+37:11371:x1870604297901184:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:0.0:1783947584.641724:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+38:11371:x1870604297901184:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 244us (423us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1783947584.641731:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 41 00010000:00010000:1.0:1783947584.825585:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947584.925883:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947584.925971:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297901440 00000100:00100000:3.0:1783947584.925980:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297901440 00000100:00100000:3.0:1783947584.926051:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 153 00000100:00100000:3.0:1783947584.926063:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+38:11402:x1870604297901440:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:3.0:1783947584.926089:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947584.926114:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb27b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab21f expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.926227:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb27b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.926242:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb27b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.926253:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb27b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947584.926264:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783947584.926400:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb27b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab21f expref: 41 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.926476:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb27b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab21f expref: 40 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.926502:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:3.0:1783947584.926506:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947584.926509:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a000, rc 0) 00000100:00100000:3.0:1783947584.926739:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+40:11402:x1870604297901440:12345-192.168.203.32@tcp:101:cat.0 Request processed in 678us (865us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1783947584.926747:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 153 00000100:00100000:3.0:1783947584.930839:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947584.931125:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297901696 00000100:00100000:0.0:1783947584.931136:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297901696 00000100:00100000:0.0:1783947584.931240:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:0.0:1783947584.931250:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+40:11402:x1870604297901696:12345-192.168.203.32@tcp:35:cat.0 00000100:00100000:0.0:1783947584.931540:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+41:11402:x1870604297901696:12345-192.168.203.32@tcp:35:cat.0 Request processed in 291us (709us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1783947584.931547:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:1.0:1783947584.933619:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947584.934441:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297901824 00000100:00100000:3.0:1783947584.934450:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297901824 00000100:00100000:3.0:1783947584.934603:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:3.0:1783947584.934614:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+41:2355:x1870604297901824:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947584.934631:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947584.934670:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb27b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab21f expref: 41 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.934689:0:8318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:3.0:1783947584.934694:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947584.934751:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+40:2355:x1870604297901824:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 139us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947584.934759:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:1.0:1783947584.981746:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947584.983208:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297902080 00000100:00100000:3.0:1783947584.983223:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297902080 00000100:00100000:3.0:1783947584.983298:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 154 00000100:00100000:3.0:1783947584.983320:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+40:11408:x1870604297902080:12345-192.168.203.32@tcp:101:dd.0 00010000:00010000:3.0:1783947584.983357:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947584.983375:0:6613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783947584.983403:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb271f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1f5 expref: 40 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.983475:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:3.0:1783947584.983481:0:6613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947584.983505:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb27c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab226 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.984027:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb27ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.984042:0:6613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb279d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab218 expref: 40 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.984052:0:6613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb27ce lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.984091:0:6613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb279d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab218 expref: 40 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947584.984106:0:6613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb279d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab218 expref: 40 pid: 5797 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947584.984120:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6613:1870604319925888:192.168.203.32@tcp:104: 00000100:00100000:3.0:1783947584.984235:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb66f20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947584.988338:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6613:1870604319925888:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947584.988368:0:6613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb27ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947584.989983:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947584.990167:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297902208 00000100:00100000:0.0:1783947584.990176:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297902208 00010000:00010000:0.0:1783947584.990214:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb279d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab218 expref: 41 pid: 5797 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947584.990252:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:0.0:1783947584.990261:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+41:2354:x1870604297902208:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947584.990295:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947584.990312:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb279d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab218 expref: 41 pid: 5797 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.990325:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb279d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab218 expref: 41 pid: 5797 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.990346:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb279d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab218 expref: 41 pid: 5797 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.990361:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:0.0:1783947584.990366:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb27ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.990375:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb27ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.990382:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb27ce lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947584.990413:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947584.990505:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+40:2354:x1870604297902208:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 244us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947584.990635:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 63 00010000:00010000:1.0:1783947584.991225:0:6613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb27ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.991235:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb27ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947584.991253:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783947584.991451:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb27c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab226 expref: 41 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.991470:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb27ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab226 expref: 40 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947584.991479:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:1.0:1783947584.991482:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783947584.991484:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1ae00, rc 0) 00000100:00100000:1.0:1783947584.991713:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+40:11408:x1870604297902080:12345-192.168.203.32@tcp:101:dd.0 Request processed in 8403us (9973us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1783947584.991721:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 154 00000100:00100000:1.0:1783947585.001517:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947585.002192:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297902464 00000100:00100000:0.0:1783947585.002202:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297902464 00000100:00100000:0.0:1783947585.002267:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 155 00000100:00100000:0.0:1783947585.002277:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+40:11408:x1870604297902464:12345-192.168.203.32@tcp:36:dd.0 00010000:00010000:0.0:1783947585.002925:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb27dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947585.002943:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb27dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947585.002954:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb27dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783947585.003094:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1783947585.003143:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1783947585.003174:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b0121884 reply state 0000000025f64364 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb27dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947585.003184:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783947585.003266:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+43:11408:x1870604297902464:12345-192.168.203.32@tcp:36:dd.0 Request processed in 989us (1768us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1783947585.003274:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 155 00000020:00080000:0.0:1783947585.003279:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783947585.005449:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb27dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.005477:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb27dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.005484:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb27dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.005490:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947585.005494:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb27dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.005510:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb27dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.005533:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:1.0:1783947585.005535:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947585.005539:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb27dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.005545:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb27dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947585.082335:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319926016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947585.082405:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947585.082560:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319926016 00000100:00100000:1.0:1783947585.082579:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319926016 00000100:00100000:1.0:1783947585.082630:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783947585.082640:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319926016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947585.082676:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783947585.083044:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319926016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 404us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947585.083053:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783947585.083140:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319926016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947585.310771:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947585.310865:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297902592 00000100:00100000:3.0:1783947585.310876:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297902592 00000100:00100000:3.0:1783947585.310943:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 156 00000100:00100000:3.0:1783947585.310954:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+42:11422:x1870604297902592:12345-192.168.203.32@tcp:101:stat.0 00010000:00010000:3.0:1783947585.310977:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947585.310998:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb27e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab22d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.312478:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb27ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.312505:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb27ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.312518:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb27ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.312546:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb27f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.312553:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb27f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.312561:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb27f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.312670:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb27f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.312684:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb27ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab226 expref: 43 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.312706:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb27f8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.313034:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb27ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab226 expref: 43 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.313107:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb27ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab226 expref: 43 pid: 6613 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947585.313510:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1870604319926144:192.168.203.32@tcp:104: 00000100:00100000:3.0:1783947585.313707:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb66f20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947585.320390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947585.320530:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1870604319926144:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947585.320559:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb27f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947585.321374:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297902848 00000100:00100000:1.0:1783947585.321385:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297902848 00000100:00100000:1.0:1783947585.321486:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:1.0:1783947585.321497:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+44:5571:x1870604297902848:12345-192.168.203.32@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783947585.321841:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+45:5571:x1870604297902848:12345-192.168.203.32@tcp:35:ldlm_bl.0 Request processed in 343us (1460us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1783947585.321849:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:2.0:1783947585.326207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947585.326614:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297902976 00000100:00100000:0.0:1783947585.326625:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297902976 00010000:00010000:0.0:1783947585.326663:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb27ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab226 expref: 45 pid: 6613 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947585.326708:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00100000:0.0:1783947585.326720:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83371880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+45:2353:x1870604297902976:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947585.326750:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947585.326759:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb27ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab226 expref: 45 pid: 6613 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947585.326772:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb27ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab226 expref: 45 pid: 6613 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947585.326806:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ae00/0x20c3e53e78bb27ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab226 expref: 45 pid: 6613 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947585.326824:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:0.0:1783947585.326829:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb27f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947585.326838:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb27f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947585.326845:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb27f8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947585.326874:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947585.326935:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83371880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+44:2353:x1870604297902976:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 212us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947585.326944:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 64 00010000:00010000:3.0:1783947585.327047:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb27f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.327056:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb27f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947585.327110:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1783947585.327115:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947585.327146:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb27f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.327165:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb27f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.327254:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb27ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.327262:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb27ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.327268:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb27ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.327274:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947585.327289:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb27ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.327298:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb27ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.327331:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:3.0:1783947585.327335:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947585.327338:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb27ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.327359:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb27ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.327373:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb27f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.327378:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb27f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.327384:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb27f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.327407:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947585.327410:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb27f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.327473:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb27f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.327485:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b3c84af9a00) 00010000:00010000:3.0:1783947585.327488:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947585.327491:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb27f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.327497:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb27f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.327535:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb27e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab22d expref: 44 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.327548:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb27f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab22d expref: 43 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.327555:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:3.0:1783947585.327557:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947585.327560:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1ba00, rc 0) 00000100:00100000:3.0:1783947585.327591:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+43:11422:x1870604297902592:12345-192.168.203.32@tcp:101:stat.0 Request processed in 16639us (16829us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947585.327598:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 156 00000100:00100000:2.0:1783947585.430882:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947585.430981:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297903232 00000100:00100000:3.0:1783947585.431014:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297903232 00000100:00100000:3.0:1783947585.431075:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 157 00000100:00100000:3.0:1783947585.431087:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+43:11429:x1870604297903232:12345-192.168.203.32@tcp:36:truncate.0 00010000:00010000:3.0:1783947585.431146:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947585.431177:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb27f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab22d expref: 43 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.431197:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:3.0:1783947585.431202:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947585.431506:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb27ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.431521:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb27ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.431531:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb27ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783947585.431583:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1783947585.431607:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b78aacb8 reply state 0000000028194594 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb27ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947585.431614:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783947585.431700:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+45:11429:x1870604297903232:12345-192.168.203.32@tcp:36:truncate.0 Request processed in 616us (828us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1783947585.431706:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 157 00000020:00080000:3.0:1783947585.431710:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783947585.440565:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb27ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.440581:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb27ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.440590:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb27ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.440596:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947585.440600:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb27ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.440608:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb27ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.440624:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:1.0:1783947585.440628:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947585.440632:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb27ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.440637:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb27ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947585.714074:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947585.714525:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297903360 00000100:00100000:1.0:1783947585.714534:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297903360 00000100:00100000:1.0:1783947585.714624:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 158 00000100:00100000:1.0:1783947585.714635:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+44:11443:x1870604297903360:12345-192.168.203.32@tcp:101:stat.0 00010000:00010000:1.0:1783947585.714657:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947585.714678:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2806 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab234 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.714737:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb280d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.714751:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb280d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.714763:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb280d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.714777:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2814 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.714784:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.714808:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.714903:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb281b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.714912:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb281b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.714933:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb281b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947585.714969:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1783947585.714974:0:6613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783947585.714995:0:6613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb281b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.715018:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb281b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.715035:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb280d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.715042:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb280d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.715049:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb280d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.715056:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947585.715061:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb280d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.715068:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb280d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.715080:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:1.0:1783947585.715083:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947585.715087:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb280d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.715104:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb280d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.715117:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.715124:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2814 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.715130:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2814 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.715135:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73ae00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947585.715138:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2814 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.715145:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2814 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.715151:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b3c82977900) 00010000:00010000:1.0:1783947585.715163:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947585.715166:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2814 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.715172:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb2814 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.715202:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2806 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab234 expref: 46 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.715215:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb281b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab234 expref: 45 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.715228:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:1.0:1783947585.715231:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947585.715234:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a600, rc 0) 00000100:00100000:1.0:1783947585.715296:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+45:11443:x1870604297903360:12345-192.168.203.32@tcp:101:stat.0 Request processed in 663us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947585.715304:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 158 00000100:00100000:2.0:1783947585.819574:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947585.819676:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297903616 00000100:00100000:3.0:1783947585.819686:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297903616 00000100:00100000:3.0:1783947585.819750:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 159 00000100:00100000:3.0:1783947585.819772:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+45:11453:x1870604297903616:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1783947585.819793:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947585.819814:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2822 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab23b expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947585.819925:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1783947585.820230:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2822 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab23b expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.820245:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c82977500) 00010000:00010000:3.0:1783947585.820248:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783947585.820253:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2822 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab23b expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.820269:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1ba00, rc 0) 00000100:00100000:3.0:1783947585.820369:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+46:11453:x1870604297903616:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 597us (803us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1783947585.820376:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 159 00000100:00100000:2.0:1783947585.828266:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947585.829025:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297903872 00000100:00100000:1.0:1783947585.829036:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297903872 00000100:00100000:1.0:1783947585.829095:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:1.0:1783947585.829105:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85b98450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+46:11453:x1870604297903872:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1783947585.829640:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85b98450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+47:11453:x1870604297903872:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 534us (1382us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1783947585.829649:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 44 00010000:00010000:2.0:1783947585.850393:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783947585.913665:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947585.913674:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947585.913916:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1783947585.913933:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783947585.917150:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947585.917300:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297904128 00000100:00100000:3.0:1783947585.917319:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297904128 00000100:00100000:3.0:1783947585.917384:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 160 00000100:00100000:3.0:1783947585.917395:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+47:11459:x1870604297904128:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1783947585.917462:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947585.917485:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2830 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab242 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.917588:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2837 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.917613:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb281b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab234 expref: 48 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.917622:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2837 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.917652:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb281b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab234 expref: 48 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.917665:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb281b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab234 expref: 48 pid: 6613 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947585.917678:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1870604319926272:192.168.203.32@tcp:104: 00000100:00100000:3.0:1783947585.917777:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb66f23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947585.921921:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1870604319926272:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947585.921954:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2837 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947585.923077:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947585.925525:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297904256 00000100:00100000:0.0:1783947585.925539:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297904256 00010000:00010000:0.0:1783947585.925590:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb281b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab234 expref: 49 pid: 6613 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947585.925662:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:0.0:1783947585.925673:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85da8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+49:2354:x1870604297904256:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947585.925691:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947585.925698:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb281b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab234 expref: 49 pid: 6613 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947585.925711:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb281b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab234 expref: 49 pid: 6613 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947585.925734:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb281b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab234 expref: 49 pid: 6613 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947585.925751:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:0.0:1783947585.925756:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2837 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947585.925766:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2837 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947585.925774:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2837 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947585.925809:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947585.925872:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85da8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+48:2354:x1870604297904256:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 201us (2802us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947585.925880:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 65 00010000:00010000:1.0:1783947585.926270:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2837 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.926279:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2837 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947585.926299:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1783947585.926496:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2830 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab242 expref: 49 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.926514:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2837 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab242 expref: 48 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.926535:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:1.0:1783947585.926538:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783947585.926540:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a000, rc 0) 00000100:00100000:1.0:1783947585.926570:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+48:11459:x1870604297904128:12345-192.168.203.32@tcp:101:bash.0 Request processed in 9177us (9431us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1783947585.926577:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 160 00000100:00100000:2.0:1783947585.930886:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947585.931147:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297904512 00000100:00100000:0.0:1783947585.931177:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297904512 00000100:00100000:0.0:1783947585.931235:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 161 00000100:00100000:0.0:1783947585.931246:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+48:11459:x1870604297904512:12345-192.168.203.32@tcp:36:bash.0 00010000:00010000:0.0:1783947585.931552:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb2845 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947585.931570:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb2845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947585.931581:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb2845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783947585.931630:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1783947585.931654:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f414829d reply state 00000000b5cfb719 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb2845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947585.931663:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783947585.931739:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+51:11459:x1870604297904512:12345-192.168.203.32@tcp:36:bash.0 Request processed in 495us (862us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1783947585.931744:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 161 00000020:00080000:0.0:1783947585.931748:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783947585.934777:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb2845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.934793:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb2845 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.934802:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb2845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.934808:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947585.934812:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb2845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.934820:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb2845 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.934836:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:1.0:1783947585.934839:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947585.934843:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb2845 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.934850:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb2845 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947585.947712:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947585.947821:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297904640 00000100:00100000:1.0:1783947585.947831:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297904640 00000100:00100000:1.0:1783947585.947893:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 162 00000100:00100000:1.0:1783947585.947903:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+50:11459:x1870604297904640:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1783947585.947926:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947585.947956:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb284c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab249 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.948063:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2853 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.948078:0:6613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2837 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab242 expref: 51 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.948086:0:6613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2853 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.948124:0:6613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2837 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab242 expref: 51 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.948137:0:6613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2837 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab242 expref: 51 pid: 5798 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947585.948149:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83373480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6613:1870604319926400:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947585.948677:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad698000 going to sleep for 11 seconds 00000100:00100000:1.0:1783947585.950910:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83373480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6613:1870604319926400:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947585.950936:0:6613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2853 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947585.951748:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947585.951826:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297904768 00000100:00100000:3.0:1783947585.951835:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297904768 00010000:00010000:3.0:1783947585.951871:0:8318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2837 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab242 expref: 52 pid: 5798 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947585.951910:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 66 00000100:00100000:3.0:1783947585.951920:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+52:2353:x1870604297904768:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947585.951934:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947585.951950:0:8318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2837 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab242 expref: 52 pid: 5798 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.951962:0:8318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2837 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab242 expref: 52 pid: 5798 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.951987:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2837 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab242 expref: 52 pid: 5798 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.952012:0:8318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:3.0:1783947585.952017:0:8318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2853 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.952036:0:8318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.952045:0:8318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2853 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947585.952074:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947585.952127:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+51:2353:x1870604297904768:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 208us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947585.952135:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 66 00010000:00010000:1.0:1783947585.952268:0:6613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.952277:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947585.952331:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783947585.952335:0:6613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783947585.952357:0:6613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.952388:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb284c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab249 expref: 51 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.952403:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab249 expref: 50 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947585.952410:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:1.0:1783947585.952413:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947585.952470:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a400, rc 0) 00000100:00100000:1.0:1783947585.952497:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+50:11459:x1870604297904640:12345-192.168.203.32@tcp:101:bash.0 Request processed in 4596us (4796us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947585.952504:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 162 00000100:00100000:2.0:1783947585.956236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947585.956297:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297905024 00000100:00100000:0.0:1783947585.956307:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297905024 00000100:00100000:0.0:1783947585.956362:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:0.0:1783947585.956372:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+50:11459:x1870604297905024:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:0.0:1783947585.956628:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+51:11459:x1870604297905024:12345-192.168.203.32@tcp:35:bash.0 Request processed in 257us (400us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1783947585.956636:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:2.0:1783947586.078560:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947586.078652:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297905280 00000100:00100000:0.0:1783947586.078676:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297905280 00000100:00100000:0.0:1783947586.078735:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 163 00000100:00100000:0.0:1783947586.078745:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+51:11469:x1870604297905280:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1783947586.078769:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947586.078789:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb285a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab250 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947586.078899:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1783947586.079017:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb285a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab250 expref: 53 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.079143:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c82977500) 00010000:00010000:0.0:1783947586.079146:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783947586.079161:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb285a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab250 expref: 53 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.079177:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670800, rc 0) 00000100:00100000:0.0:1783947586.079235:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+52:11469:x1870604297905280:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 491us (683us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1783947586.079243:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 163 00000100:00100000:2.0:1783947586.083530:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947586.083696:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297905408 00000100:00100000:3.0:1783947586.083706:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297905408 00000100:00100000:3.0:1783947586.083768:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 164 00000100:00100000:3.0:1783947586.083780:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+52:11469:x1870604297905408:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:3.0:1783947586.083869:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2868 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.083903:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2868 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.083915:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2868 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.083930:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb286f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.083937:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb286f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.083943:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb286f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084325:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2876 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084336:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084344:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783947586.084386:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084398:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2868 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084404:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2868 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084457:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2868 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084462:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947586.084467:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2868 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084474:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2868 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084486:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:3.0:1783947586.084490:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947586.084494:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2868 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084500:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2868 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084516:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb286f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084521:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb286f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084526:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb286f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084530:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947586.084533:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb286f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084548:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb286f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084555:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b3c84af9a00) 00010000:00010000:3.0:1783947586.084557:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947586.084561:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb286f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084566:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb286f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084578:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084583:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2876 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084588:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084593:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1ba00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947586.084596:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084600:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2876 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084606:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:3.0:1783947586.084608:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947586.084610:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2876 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.084625:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2876 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947586.084700:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+52:11469:x1870604297905408:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 920us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947586.084708:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 164 00000100:00100000:2.0:1783947586.088039:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947586.088296:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297905664 00000100:00100000:0.0:1783947586.088307:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297905664 00000100:00100000:0.0:1783947586.088362:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:0.0:1783947586.088372:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+52:11469:x1870604297905664:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:0.0:1783947586.088649:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+53:11469:x1870604297905664:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 277us (626us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1783947586.088657:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:2.0:1783947586.139083:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947586.139175:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297905920 00000100:00100000:0.0:1783947586.139185:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297905920 00000100:00100000:0.0:1783947586.139238:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 165 00000100:00100000:0.0:1783947586.139247:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+53:11472:x1870604297905920:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1783947586.139270:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947586.139291:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb287d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab257 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139377:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2884 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139393:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2884 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139403:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2884 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139446:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb288b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139453:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb288b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139460:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb288b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139578:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb2892 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139587:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb2892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139610:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb2892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947586.139622:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1783947586.139712:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2884 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139719:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2884 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139724:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2884 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139729:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947586.139733:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2884 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139740:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2884 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139752:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:0.0:1783947586.139755:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947586.139759:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2884 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139766:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2884 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139780:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb288b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139785:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb288b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139810:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb288b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139816:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947586.139819:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb288b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139824:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb288b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139832:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b3c8281b500) 00010000:00010000:0.0:1783947586.139834:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947586.139837:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb288b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139842:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb288b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139885:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb287d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab257 expref: 56 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139898:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb2892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab257 expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.139905:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:0.0:1783947586.139907:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947586.139910:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671200, rc 0) 00000100:00100000:0.0:1783947586.139975:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+55:11472:x1870604297905920:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 728us (900us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1783947586.140004:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 165 00000100:00100000:2.0:1783947586.145683:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947586.145730:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947586.145817:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297906048 00000100:00100000:0.0:1783947586.145827:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297906048 00000100:00100000:0.0:1783947586.145888:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:0.0:1783947586.145899:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+55:2354:x1870604297906048:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947586.145913:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947586.145937:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb2892 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab257 expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.145954:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:0.0:1783947586.145958:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947586.146018:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+54:2354:x1870604297906048:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 121us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947586.146034:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:1.0:1783947586.147027:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297906176 00000100:00100000:1.0:1783947586.147037:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297906176 00000100:00100000:1.0:1783947586.147085:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 166 00000100:00100000:1.0:1783947586.147094:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+54:11472:x1870604297906176:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:1.0:1783947586.147161:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.147188:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.147199:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.147229:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.147235:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.147241:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.147247:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73ae00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947586.147251:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.147257:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.147266:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:1.0:1783947586.147269:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947586.147272:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.147278:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947586.147573:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+54:11472:x1870604297906176:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 478us (1841us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947586.147587:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 166 00000100:00100000:2.0:1783947586.152528:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947586.152621:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297906432 00000100:00100000:0.0:1783947586.152633:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297906432 00000100:00100000:0.0:1783947586.152687:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:0.0:1783947586.152698:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+54:11472:x1870604297906432:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:0.0:1783947586.152943:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+55:11472:x1870604297906432:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 247us (425us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1783947586.152951:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:2.0:1783947586.409603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947586.410048:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297906688 00000100:00100000:0.0:1783947586.410062:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297906688 00000100:00100000:0.0:1783947586.410125:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 167 00000100:00100000:0.0:1783947586.410135:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+55:11490:x1870604297906688:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:0.0:1783947586.410173:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947586.410193:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb28a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab25e expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.410306:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb28ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.410320:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb28ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.410332:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb28ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947586.410343:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1783947586.410501:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb28a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab25e expref: 58 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.410521:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb28ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab25e expref: 57 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.410531:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:0.0:1783947586.410534:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783947586.410537:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670800, rc 0) 00000100:00100000:0.0:1783947586.410593:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+57:11490:x1870604297906688:12345-192.168.203.32@tcp:101:cat.0 Request processed in 459us (1000us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1783947586.410600:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 167 00000100:00100000:2.0:1783947586.440951:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947586.441107:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297906816 00000100:00100000:3.0:1783947586.441117:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297906816 00000100:00100000:3.0:1783947586.441183:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 168 00000100:00100000:3.0:1783947586.441194:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+57:11491:x1870604297906816:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1783947586.441218:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947586.441239:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb28bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab265 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.441316:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb28c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.441329:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb28c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.441340:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb28c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947586.441397:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1783947586.441401:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947586.441472:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb28c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.441499:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb28bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab265 expref: 59 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.441530:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb28c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab265 expref: 58 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.441538:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:3.0:1783947586.441541:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947586.441544:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a600, rc 0) 00000100:00100000:3.0:1783947586.441612:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+58:11491:x1870604297906816:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 420us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947586.441619:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 168 00000100:00100000:2.0:1783947586.448156:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947586.450718:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297907200 00000100:00100000:1.0:1783947586.450733:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297907200 00000100:00100000:1.0:1783947586.450811:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:1.0:1783947586.450822:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+58:11491:x1870604297907200:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1783947586.451194:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+59:11491:x1870604297907200:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 373us (3054us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1783947586.451202:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:2.0:1783947586.454691:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947586.454766:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297907328 00000100:00100000:3.0:1783947586.454776:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297907328 00000100:00100000:3.0:1783947586.454850:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:3.0:1783947586.454860:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+59:11491:x1870604297907328:12345-192.168.203.32@tcp:103:lfs.0 00010000:00010000:3.0:1783947586.454874:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783947586.454906:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2853 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab249 expref: 59 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.454928:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb28ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab25e expref: 58 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.454943:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb275e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab20a expref: 57 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.454952:0:8318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:3.0:1783947586.454963:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947586.455043:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+56:11491:x1870604297907328:12345-192.168.203.32@tcp:103:lfs.0 Request processed in 184us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947586.455050:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:3.0:1783947586.460841:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947586.461060:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297907456 00000100:00100000:0.0:1783947586.461071:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297907456 00000100:00100000:0.0:1783947586.461140:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 169 00000100:00100000:0.0:1783947586.461172:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+56:11491:x1870604297907456:12345-192.168.203.32@tcp:58:lfs.0 00010000:00010000:0.0:1783947586.461571:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb28ca lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.461589:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb28ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947586.461600:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb28ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783947586.461807:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1783947586.461891:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+56:11491:x1870604297907456:12345-192.168.203.32@tcp:58:lfs.0 Request processed in 719us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947586.463319:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 169 00000100:00100000:3.0:1783947586.489770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947586.490563:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297907584 00000100:00100000:1.0:1783947586.490577:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297907584 00000100:00100000:1.0:1783947586.490654:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 170 00000100:00100000:1.0:1783947586.490665:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+56:11493:x1870604297907584:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1783947586.490684:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947586.490703:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb28d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab26c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.490768:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb28d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.490782:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb28d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.490967:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb28d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.490984:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.491147:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.491154:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.493051:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb28e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.493068:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb28e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.493079:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb28e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947586.493123:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783947586.493127:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783947586.493145:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb28e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.495915:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb28e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.495931:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb28d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.495937:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb28d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.495944:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb28d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.495971:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947586.495976:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb28d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.495983:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb28d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.496009:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:1.0:1783947586.496013:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947586.496017:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb28d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.496023:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb28d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.496039:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.496045:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.496050:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.496055:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73ae00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947586.496058:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.496063:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.496084:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b3c82977900) 00010000:00010000:1.0:1783947586.496086:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947586.496089:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.496094:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb28df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.496146:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb28d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab26c expref: 58 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.496173:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb28e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab26c expref: 57 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947586.496180:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281b500) 00010000:00010000:1.0:1783947586.496183:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947586.496185:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a400, rc 0) 00000100:00100000:1.0:1783947586.496266:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+57:11493:x1870604297907584:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 5601us (6505us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947586.496276:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 170 00010000:00010000:1.0:1783947586.873641:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783947586.938708:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947586.938723:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947586.938769:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1783947586.938777:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783947586.938948:0:11551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd49d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870604319926528:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783947586.939087:0:11551:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947586.942319:0:11551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd49d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870604319926528:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783947586.946885:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947586.947022:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297907712 00000100:00100000:3.0:1783947586.947035:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297907712 00000100:00100000:3.0:1783947586.947111:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 171 00000100:00100000:3.0:1783947586.947123:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+57:11504:x1870604297907712:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783947586.947171:0:5797:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783947586.947320:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+57:11504:x1870604297907712:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 199us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947586.947328:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 171 00000100:00100000:0.0:1783947586.951892:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947586.954373:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297907840 00000100:00100000:3.0:1783947586.954399:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297907840 00000100:00100000:3.0:1783947586.954533:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 172 00000100:00100000:3.0:1783947586.954548:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+57:11504:x1870604297907840:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783947586.954668:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb28ed lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.954694:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb28ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.954709:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb28ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.956903:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb28f4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.961921:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb28f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.961942:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb28f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962004:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb28fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962014:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb28fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962022:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb28fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947586.962064:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1783947586.962069:0:6613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947586.962082:0:6613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb28fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962095:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb28ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962102:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb28ed lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962109:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb28ed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962114:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1ba00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947586.962118:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb28ed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962140:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb28ed lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962153:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b3c84bc6300) 00010000:00010000:3.0:1783947586.962156:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947586.962162:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb28ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962168:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb28ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962179:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb28f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962185:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb28f4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962190:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb28f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962194:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947586.962196:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb28f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962201:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb28f4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962207:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8b3c84af9a00) 00010000:00010000:3.0:1783947586.962209:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947586.962211:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb28f4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962225:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb28f4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962241:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb28fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962246:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb28fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962251:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb28fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962255:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947586.962258:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb28fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962263:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb28fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962270:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281b500) 00010000:00010000:3.0:1783947586.962272:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947586.962275:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb28fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947586.962280:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb28fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947586.962627:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+57:11504:x1870604297907840:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 Request processed in 8077us (10740us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947586.962639:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 172 00000100:00100000:1.0:1783947586.968931:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947586.969043:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297908096 00000100:00100000:2.0:1783947586.969078:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297908096 00000100:00100000:2.0:1783947586.969195:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 173 00000100:00100000:2.0:1783947586.969209:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+57:11504:x1870604297908096:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947586.969240:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947586.969269:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2902 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab273 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947586.969407:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2909 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947586.969445:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947586.969460:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947586.969473:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783947586.969621:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947586.969632:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2909 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947586.969640:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2909 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947586.969649:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947586.969654:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2909 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947586.969663:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2909 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947586.969689:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281b500) 00010000:00010000:2.0:1783947586.969693:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947586.969699:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2909 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947586.969705:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2909 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947586.969758:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2902 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab273 expref: 59 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947586.969770:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b3c84bc6300) 00010000:00010000:2.0:1783947586.969773:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947586.969777:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2902 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab273 expref: 59 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947586.969787:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631800, rc 0) 00000100:00100000:2.0:1783947586.969875:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+58:11504:x1870604297908096:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 669us (958us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1783947586.969884:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 173 00000100:00100000:3.0:1783947586.973798:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947586.980369:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297908224 00000100:00100000:1.0:1783947586.980394:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297908224 00000100:00100000:1.0:1783947586.980529:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 174 00000100:00100000:1.0:1783947586.980542:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+58:11504:x1870604297908224:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783947586.984245:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783947586.984501:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+58:11504:x1870604297908224:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 3954us (10703us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947586.984516:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 174 00000100:00100000:1.0:1783947587.000506:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947587.001221:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297908480 00000100:00100000:3.0:1783947587.001234:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297908480 00000100:00100000:3.0:1783947587.001313:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 175 00000100:00100000:3.0:1783947587.001325:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+58:11504:x1870604297908480:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947587.001348:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947587.001353:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783947587.001390:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb28c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab265 expref: 58 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.001409:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:3.0:1783947587.001414:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947587.001452:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2917 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab27a expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783947587.002207:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00000100:00080000:1.0:1783947587.003626:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783947587.003682:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb291e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.003700:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb291e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.003712:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb291e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.003907:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2917 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab27a expref: 60 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.003929:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb291e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab27a expref: 59 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.003955:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b3c84af9a00) 00010000:00010000:3.0:1783947587.003958:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947587.003961:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a000, rc 0) 00000100:00100000:3.0:1783947587.004104:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+59:11504:x1870604297908480:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 2781us (3619us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1783947587.004114:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 175 00000100:00100000:1.0:1783947587.017134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947587.018005:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297908736 00000100:00100000:3.0:1783947587.018016:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297908736 00000100:00100000:3.0:1783947587.018085:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 176 00000100:00100000:3.0:1783947587.018270:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+59:11504:x1870604297908736:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783947587.018345:0:6613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947587.018495:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb291e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab27a expref: 59 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.018586:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b3c84af9a00) 00010000:00010000:3.0:1783947587.018599:0:6613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947587.019836:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb292c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.019858:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb292c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.019872:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb292c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.019955:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2933 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf8245b9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.019965:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2933 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf8245b9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.019973:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2933 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf8245b9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.020073:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb292c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.020081:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb292c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.020087:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb292c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.020104:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947587.020109:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb292c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.020118:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb292c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.020131:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:2.0:1783947587.020134:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947587.020138:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb292c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.021605:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb292c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.021657:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2933 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf8245b9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.021664:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2933 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf8245b9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.021672:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2933 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf8245b9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.021680:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947587.021684:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2933 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf8245b9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.021691:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2933 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf8245b9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.021704:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf8245b9f (ffff8b3c84bc6600) 00010000:00010000:2.0:1783947587.021708:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947587.021712:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2933 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf8245b9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.021720:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2933 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf8245b9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947587.022286:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+58:11504:x1870604297908736:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 4021us (5157us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783947587.022584:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 176 00000100:00100000:2.0:1783947587.027085:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947587.027539:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297908864 00000100:00100000:3.0:1783947587.027550:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297908864 00000100:00100000:3.0:1783947587.027621:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 177 00000100:00100000:3.0:1783947587.027631:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+58:11504:x1870604297908864:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947587.027655:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947587.027677:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb293a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab281 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.027716:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2941 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.027736:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.027747:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.027953:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb293a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab281 expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.027972:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2941 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab281 expref: 59 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.027980:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b3c84af9300) 00010000:00010000:3.0:1783947587.027983:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783947587.027998:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a600, rc 0) 00000100:00100000:3.0:1783947587.028066:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+59:11504:x1870604297908864:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 436us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947587.028073:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 177 00000100:00100000:1.0:1783947587.033769:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947587.033843:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297909120 00000100:00100000:3.0:1783947587.033859:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297909120 00000100:00100000:3.0:1783947587.033922:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 178 00000100:00100000:3.0:1783947587.033933:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+59:11504:x1870604297909120:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783947587.034027:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2948 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.034043:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.034074:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783947587.034412:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1783947587.034465:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 402305045765ns, next at 403305043089ns, rc = 0 00000004:00010000:3.0:1783947587.034555:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fb8005bd reply state 0000000031b1df79 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947587.034564:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783947587.034656:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+61:11504:x1870604297909120:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 724us (900us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1783947587.034663:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 178 00010000:00010000:2.0:1783947587.040151:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.040185:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2948 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.040194:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2948 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.040201:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1ba00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947587.040207:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2948 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.040217:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2948 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.040240:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b3c84af9300) 00010000:00010000:2.0:1783947587.040243:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783947587.040249:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2948 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.040256:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2948 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947587.047860:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947587.048070:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297909248 00000100:00100000:1.0:1783947587.048084:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297909248 00000100:00100000:1.0:1783947587.049288:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 179 00000100:00100000:1.0:1783947587.049384:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+60:11504:x1870604297909248:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947587.049518:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947587.049682:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb294f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab288 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.049789:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb294f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab288 expref: 61 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.049810:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb294f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab288 expref: 61 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.049836:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b3c84af9300) 00010000:00010000:1.0:1783947587.049839:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783947587.049845:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73bc00, rc 0) 00000100:00100000:1.0:1783947587.049950:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+61:11504:x1870604297909248:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 579us (2103us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947587.049963:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 179 00000100:00100000:3.0:1783947587.071661:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947587.072255:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297909376 00000100:00100000:2.0:1783947587.072272:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297909376 00000100:00080000:0.0:1783947587.072373:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947587.072395:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:2.0:1783947587.072409:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2353:x1870604297909376:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783947587.072898:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2353:x1870604297909376:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 490us (1245us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1783947587.072908:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:0.0:1783947587.090661:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947587.090765:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297909632 00000100:00100000:0.0:1783947587.090774:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297909632 00000100:00100000:0.0:1783947587.090823:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:0.0:1783947587.090834:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+61:11504:x1870604297909632:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783947587.091076:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+62:11504:x1870604297909632:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 243us (425us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1783947587.091085:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:1.0:1783947587.099954:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947587.107355:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297909888 00000100:00100000:3.0:1783947587.107387:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297909888 00000100:00100000:3.0:1783947587.107482:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 180 00000100:00100000:3.0:1783947587.107492:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+62:11504:x1870604297909888:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783947587.107605:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+62:11504:x1870604297909888:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 115us (7665us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947587.107613:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 180 00000100:00100000:0.0:1783947587.118478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947587.121123:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297910016 00000100:00100000:3.0:1783947587.121138:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297910016 00000100:00100000:3.0:1783947587.121280:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 181 00000100:00100000:3.0:1783947587.121291:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+62:11504:x1870604297910016:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947587.121313:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947587.121334:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2956 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab28f expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.121445:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb295d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.121459:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb295d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.121470:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb295d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947587.121504:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947587.121526:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb295d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.121558:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2956 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab28f expref: 64 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.121577:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb295d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab28f expref: 63 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.121586:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b3c84af9300) 00010000:00010000:3.0:1783947587.121589:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783947587.121593:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a000, rc 0) 00000100:00100000:3.0:1783947587.121662:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+63:11504:x1870604297910016:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 372us (3251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947587.121669:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 181 00000100:00100000:2.0:1783947587.125951:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947587.126042:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297910144 00000100:00100000:3.0:1783947587.126051:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297910144 00000100:00100000:3.0:1783947587.126107:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:3.0:1783947587.126123:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2354:x1870604297910144:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947587.126141:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947587.126159:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2964 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab296 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947587.126183:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54e142, blocks: 0x1 00010000:00010000:3.0:1783947587.126202:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=402s v=(0 0) 00010000:00010000:3.0:1783947587.126207:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947587.126227:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2964 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab296 expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.126246:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2964 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab296 expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.126258:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1ae00, rc 0) 00000100:00100000:3.0:1783947587.126320:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2354:x1870604297910144:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 198us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947587.126327:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:2.0:1783947587.129876:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947587.130150:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297910400 00000100:00100000:3.0:1783947587.130161:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297910400 00000100:00100000:3.0:1783947587.130249:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 182 00000100:00100000:3.0:1783947587.130260:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+63:11504:x1870604297910400:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783947587.130381:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+63:11504:x1870604297910400:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 123us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947587.130390:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 182 00000100:00100000:0.0:1783947587.141093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947587.141143:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297910528 00000100:00100000:3.0:1783947587.141154:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297910528 00000100:00100000:3.0:1783947587.141215:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:3.0:1783947587.141225:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:11504:x1870604297910528:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947587.141243:0:8151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947587.141261:0:8151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009d64a8f/0x20c3e53e78bb296b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab29d expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.141291:0:8151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2964 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab296 expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.141301:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947587.141306:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947587.141312:0:8151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009d64a8f/0x20c3e53e78bb296b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab29d expref: 9 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.141345:0:8151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2964 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab296 expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.141358:0:8151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2964 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab296 expref: 9 pid: 6590 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947587.141390:0:8151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85dac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8151:1870604319926656:192.168.203.32@tcp:104: 00000100:00100000:3.0:1783947587.141501:0:8151:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb66f2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783947587.148036:0:8151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85dac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8151:1870604319926656:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947587.148072:0:8151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009d64a8f/0x20c3e53e78bb296b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab29d expref: 9 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.148101:0:8151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a400, rc 0) 00000100:00100000:3.0:1783947587.148153:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:11504:x1870604297910528:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 6930us (7069us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947587.148156:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947587.148162:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:0.0:1783947587.148289:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297910656 00000100:00100000:0.0:1783947587.148302:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297910656 00010000:00010000:0.0:1783947587.148336:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2964 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab296 expref: 9 pid: 6590 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947587.150317:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 67 00000100:00100000:0.0:1783947587.150339:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2353:x1870604297910656:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947587.150360:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947587.150854:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2964 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab296 expref: 9 pid: 6590 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.150871:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2964 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab296 expref: 9 pid: 6590 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.150896:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2964 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab296 expref: 9 pid: 6590 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.150910:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947587.150915:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947587.150923:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009d64a8f/0x20c3e53e78bb296b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab29d expref: 8 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.150933:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009d64a8f/0x20c3e53e78bb296b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab29d expref: 8 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.150970:0:5783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009d64a8f/0x20c3e53e78bb296b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab29d expref: 8 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947587.151010:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85bc5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5783:1870604319926784:192.168.203.32@tcp:105: 00000100:00100000:0.0:1783947587.151576:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c813770c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947587.157750:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85bc5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5783:1870604319926784:192.168.203.32@tcp:105: 00010000:00010000:2.0:1783947587.157777:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947587.157832:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2353:x1870604297910656:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 7503us (10113us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947587.157843:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 67 00000100:00100000:2.0:1783947587.157956:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947587.158053:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297910784 00000100:00100000:2.0:1783947587.158061:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297910784 00002000:00100000:2.0:1783947587.158102:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8b3b856eed80 x1870604297910784/t0(0) o4->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:378/0 lens 504/0 e 0 to 0 dl 1783947598 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783947587.158113:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3b856eed80 with x1870604297910784 ext(0->8) 00002000:00010000:2.0:1783947587.158119:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b3b856eed80 00000100:00100000:2.0:1783947587.158139:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:2.0:1783947587.158148:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2354:x1870604297910784:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783947587.158852:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+10:2354:x1870604297910784:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 Request processed in 700us (891us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1783947587.158862:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00002000:00100000:2.0:1783947587.158870:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8b3b856eed80 x1870604297910784/t4294967314(0) o4->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:378/0 lens 504/448 e 0 to 0 dl 1783947598 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783947587.158879:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3b856eed80 with x1870604297910784 ext(0->8) 00002000:00010000:2.0:1783947587.158883:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b3b856eed80 00000100:00100000:3.0:1783947587.162760:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947587.163356:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297910912 00000100:00100000:0.0:1783947587.163366:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297910912 00000100:00100000:0.0:1783947587.163454:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 183 00000100:00100000:0.0:1783947587.163464:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+63:11504:x1870604297910912:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1783947587.222534:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+63:11504:x1870604297910912:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 Request processed in 59061us (59772us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947587.222548:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 183 00000001:00080000:0.0:1783947587.222583:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1783947587.222643:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1783947587.222662:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b3cad698540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1783947587.222666:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b3caec59b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b3cad698300 00000020:00080000:0.0:1783947587.222669:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b3caec59300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b3cb65acc00 00000004:00080000:0.0:1783947587.222703:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1783947587.222938:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1783947587.223131:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1783947587.223208:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319926912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783947587.223258:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947587.225546:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85bc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319927040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783947587.225610:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947587.225668:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319926912 00000100:00100000:0.0:1783947587.225676:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319926912 00000100:00100000:0.0:1783947587.225745:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319927040 00000100:00100000:0.0:1783947587.225748:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319927040 00000100:00100000:0.0:1783947587.225776:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783947587.225785:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1870604319926912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783947587.225813:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1783947587.225848:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a54e13f, atime: 0x6a54e13f, ctime: 0x6a54e13f, blocks: 0x1 00010000:00010000:0.0:1783947587.225856:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a17cc7d/0x20c3e53e78bb2972 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.225872:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=402s v=(0 0) 00010000:00010000:0.0:1783947587.225877:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947587.225884:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a17cc7d/0x20c3e53e78bb2972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.225900:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a17cc7d/0x20c3e53e78bb2972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.225910:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a17cc7d/0x20c3e53e78bb2972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.225918:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a17cc7d/0x20c3e53e78bb2972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.225936:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1783947587.230949:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783947587.230957:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947587.231013:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783947587.231037:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319927040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1783947587.231178:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783947587.231182:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783947586 00002000:00010000:2.0:1783947587.231185:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783947587.231187:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783947586 -> 1783947586 00002000:00010000:2.0:1783947587.231189:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1783947587.231266:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1870604319927040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 234us (5655us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1783947587.231274:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783947587.231841:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1870604319926912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6054us (8579us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1783947587.231850:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:0.0:1783947587.231887:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947587.231895:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a17cc7d/0x20c3e53e78bb2972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.231905:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671600 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947587.231910:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a17cc7d/0x20c3e53e78bb2972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.231920:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a17cc7d/0x20c3e53e78bb2972 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.231939:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a17cc7d/0x20c3e53e78bb2972 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.231947:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a17cc7d/0x20c3e53e78bb2972 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.231966:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947587.231968:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947587.231970:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783947587.232013:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b3b85bc5c00/2, rc 0, transno 4294967315 00000100:00100000:0.0:1783947587.232020:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85bc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319927040:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1783947587.232062:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b3b85bc6300/2, rc 0, transno 4294967307 00000100:00100000:2.0:1783947587.232069:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319926912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783947587.235451:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947587.235932:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297911040 00000100:00100000:2.0:1783947587.235942:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297911040 00000100:00100000:2.0:1783947587.236007:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:2.0:1783947587.236016:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+10:2353:x1870604297911040:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1783947587.321663:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+10:2353:x1870604297911040:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 Request processed in 85638us (86210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947587.321676:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 55 00000001:00080000:3.0:1783947587.323190:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1783947587.323207:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1783947587.329644:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947587.329717:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297911296 00000100:00100000:2.0:1783947587.329728:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297911296 00000100:00100000:2.0:1783947587.329781:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 184 00000100:00100000:2.0:1783947587.329791:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:11504:x1870604297911296:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783947587.329847:0:6613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947587.329873:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb295d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab28f expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.329909:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b3c84af9300) 00010000:00010000:2.0:1783947587.329914:0:6613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947587.329947:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2979 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.329960:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2979 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.329970:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2979 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783947587.332862:0:6613:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d36f4ec1 reply state 00000000d791e54d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2979 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947587.332879:0:6613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783947587.333699:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:11504:x1870604297911296:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 3214us (3368us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1783947587.333714:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 184 00000100:00100000:2.0:1783947587.362320:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947587.363121:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297911424 00000100:00100000:0.0:1783947587.363132:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297911424 00000100:00100000:0.0:1783947587.363190:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00100000:0.0:1783947587.363200:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2353:x1870604297911424:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783947587.366254:0:6591:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1783947587.366264:0:6591:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1783947586 -> 1783947585 00002000:00010000:0.0:1783947587.366267:0:6591:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783947583 00002000:00010000:0.0:1783947587.366269:0:6591:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783947586 -> 1783947585 00002000:00010000:0.0:1783947587.366270:0:6591:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1783947587.366369:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2353:x1870604297911424:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 3164us (4050us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1783947587.366383:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 56 00010000:00010000:1.0:1783947587.369415:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2979 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.369449:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2979 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.369458:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2979 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.369464:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631e00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947587.369469:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2979 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.369476:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2979 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.369495:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b3c84af9300) 00010000:00010000:1.0:1783947587.369498:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947587.369502:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2979 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.369508:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2979 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947587.369704:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947587.370367:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297911680 00000100:00100000:1.0:1783947587.370378:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297911680 00000100:00100000:1.0:1783947587.370455:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 185 00000100:00100000:1.0:1783947587.370465:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:11504:x1870604297911680:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783947587.370526:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2980 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.370556:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2941 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab281 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.370566:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2980 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.370599:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2941 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab281 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.370612:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2941 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab281 expref: 18 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947587.370626:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aefb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5795:1870604319927168:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947587.370728:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b85d93b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783947587.381777:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947587.383013:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297911808 00000100:00100000:2.0:1783947587.383026:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297911808 00010000:00010000:2.0:1783947587.383070:0:8318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2941 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab281 expref: 19 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947587.383107:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:2.0:1783947587.383117:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:2353:x1870604297911808:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947587.383132:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947587.383140:0:8318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2941 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab281 expref: 19 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.383159:0:8318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2941 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab281 expref: 19 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.383181:0:8318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b3c84af9300) 00010000:00010000:2.0:1783947587.383187:0:8318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2980 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.383197:0:8318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2980 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.383204:0:8318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2980 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.383221:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947587.384026:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:2353:x1870604297911808:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 905us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947587.384037:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 68 00010000:00010000:1.0:1783947587.389003:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2941 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab281 expref: 18 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947587.389031:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aefb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5795:1870604319927168:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947587.389056:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2980 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.389066:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2980 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.389072:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2980 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.389107:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2980 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.389131:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2980 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.389137:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2980 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.389142:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947587.389146:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2980 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.389153:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2980 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.389168:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b3c84af9300) 00010000:00010000:1.0:1783947587.389171:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783947587.389174:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2980 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.389180:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2980 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947587.395799:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+17:11504:x1870604297911680:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 Request processed in 25323us (26087us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783947587.395817:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 185 00000100:00100000:0.0:1783947587.408269:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947587.408350:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297911936 00000100:00100000:1.0:1783947587.408361:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297911936 00000100:00100000:1.0:1783947587.408532:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:1.0:1783947587.408544:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2354:x1870604297911936:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783947587.408582:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006e4cf792/0x20c3e53e78bb2987 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.408608:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009d64a8f/0x20c3e53e78bb296b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab29d expref: 8 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.408616:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947587.408620:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783947587.408624:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e4cf792/0x20c3e53e78bb2987 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.408659:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009d64a8f/0x20c3e53e78bb296b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab29d expref: 8 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.408850:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009d64a8f/0x20c3e53e78bb296b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab29d expref: 8 pid: 8151 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947587.408865:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1870604319927296:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947587.408978:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b85d93b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783947587.417337:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1870604319927296:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947587.417367:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006e4cf792/0x20c3e53e78bb2987 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947587.419348:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947587.423288:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297912064 00000100:00100000:2.0:1783947587.423304:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297912064 00010000:00010000:2.0:1783947587.423352:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009d64a8f/0x20c3e53e78bb296b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab29d expref: 9 pid: 8151 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947587.423401:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:2.0:1783947587.423719:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87978700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2354:x1870604297912064:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947587.423738:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947587.423762:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009d64a8f/0x20c3e53e78bb296b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab29d expref: 9 pid: 8151 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.423796:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009d64a8f/0x20c3e53e78bb296b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab29d expref: 9 pid: 8151 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.423822:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009d64a8f/0x20c3e53e78bb296b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab29d expref: 9 pid: 8151 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.423840:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947587.423845:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947587.423851:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006e4cf792/0x20c3e53e78bb2987 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.423861:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e4cf792/0x20c3e53e78bb2987 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.423900:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947587.424041:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87978700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2354:x1870604297912064:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 632us (4701us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947587.424051:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 69 00010000:00010000:0.0:1783947587.425123:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006e4cf792/0x20c3e53e78bb2987 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.425141:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e4cf792/0x20c3e53e78bb2987 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.425175:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006e4cf792/0x20c3e53e78bb2987 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.425184:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e4cf792/0x20c3e53e78bb2987 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.425191:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e4cf792/0x20c3e53e78bb2987 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.425198:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a800 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947587.425203:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e4cf792/0x20c3e53e78bb2987 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.425218:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e4cf792/0x20c3e53e78bb2987 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.425234:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e4cf792/0x20c3e53e78bb2987 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.425243:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e4cf792/0x20c3e53e78bb2987 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947587.425324:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2354:x1870604297911936:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 Request processed in 16779us (17062us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947587.425334:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:3.0:1783947587.428777:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947587.428957:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297912320 00000100:00100000:0.0:1783947587.428968:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297912320 00000100:00100000:0.0:1783947587.429042:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 186 00000100:00100000:0.0:1783947587.429053:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c8797b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+17:11504:x1870604297912320:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783947587.429131:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb298e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.429148:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb298e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.429159:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb298e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.429356:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2995 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.429377:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb294f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab288 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.429385:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2995 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.429450:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb294f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab288 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.429465:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb294f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab288 expref: 18 pid: 5795 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947587.429479:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85bc5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1870604319927424:192.168.203.32@tcp:104: 00000100:00100000:0.0:1783947587.429548:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cbd501480 going to sleep for 11 seconds 00000100:00100000:3.0:1783947587.434893:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85bc5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1870604319927424:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947587.434922:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2995 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947587.443262:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947587.443301:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297912448 00000100:00100000:3.0:1783947587.443311:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297912448 00010000:00010000:3.0:1783947587.443394:0:8318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb294f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab288 expref: 19 pid: 5795 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947587.443444:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 70 00000100:00100000:3.0:1783947587.443453:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87978a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:2354:x1870604297912448:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947587.443467:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947587.443474:0:8318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb294f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab288 expref: 19 pid: 5795 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.443492:0:8318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb294f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab288 expref: 19 pid: 5795 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.443513:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb294f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab288 expref: 19 pid: 5795 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.443528:0:8318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b3c84af9300) 00010000:00010000:3.0:1783947587.443533:0:8318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2995 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.443542:0:8318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2995 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.443549:0:8318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2995 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.443571:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947587.443622:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87978a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:2354:x1870604297912448:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 170us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947587.443630:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 70 00010000:00010000:3.0:1783947587.443726:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2995 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.443735:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2995 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783947587.443953:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1783947587.444109:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1783947587.444154:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1783947587.444237:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5797:1870604319927552:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783947587.444281:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947587.444309:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb66f26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947587.444332:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319927552 00000100:00100000:3.0:1783947587.444336:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319927552 00000100:00100000:3.0:1783947587.444369:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947587.444376:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1870604319927552:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783947587.444458:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1870604319927552:12345-0@lo:1000:mdt00_001.0 Request processed in 82us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947587.444465:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947587.444503:0:5797:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1783947587.444508:0:5797:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b3b85bc5c00, transno 4294967315 00000100:00100000:3.0:1783947587.444522:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5797:1870604319927552:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1783947587.444960:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1783947587.445027:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5797:1870604319927680:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783947587.445059:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947587.445089:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb66f2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947587.445785:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319927680 00000100:00100000:0.0:1783947587.445792:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319927680 00000100:00100000:0.0:1783947587.445833:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783947587.445842:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1870604319927680:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783947587.446780:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5797:1870604319927680:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1783947587.446820:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2995 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.446830:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2995 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.446838:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2995 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.446845:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947587.446858:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2995 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.446867:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2995 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.446882:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b3c84af9300) 00010000:00010000:3.0:1783947587.446886:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783947587.446890:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2995 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.446898:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2995 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.446929:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb28ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.446935:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb28ca lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.446940:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb28ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.446945:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947587.446948:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb28ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.446953:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb28ca lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.446960:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281b500) 00010000:00010000:3.0:1783947587.446963:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783947587.446972:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb28ca lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.446978:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb28ca lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.447119:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb299c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.447136:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb28e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab26c expref: 21 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.447144:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb299c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.447176:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb28e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab26c expref: 21 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.447190:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb28e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab26c expref: 21 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947587.447205:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d60000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1870604319927808:192.168.203.32@tcp:104: 00000100:00100000:3.0:1783947587.447280:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb66f2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947587.448052:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5797:x1870604319927680:12345-0@lo:1000:mdt00_001.0 Request processed in 765us (1544us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1783947587.448065:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947587.453323:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947587.453350:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297912576 00000100:00100000:3.0:1783947587.453357:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297912576 00000100:00100000:1.0:1783947587.453357:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d60000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1870604319927808:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947587.453381:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb299c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.453523:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb28e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab26c expref: 22 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947587.453556:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 71 00000100:00100000:3.0:1783947587.453566:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+22:2354:x1870604297912576:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947587.453584:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947587.453592:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb28e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab26c expref: 22 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.453603:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb28e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab26c expref: 22 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.453624:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb28e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab26c expref: 22 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.453638:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281b500) 00010000:00010000:3.0:1783947587.453643:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb299c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.453654:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb299c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.453661:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb299c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.453703:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947587.453748:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:2354:x1870604297912576:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 183us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947587.453755:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 71 00010000:00010000:1.0:1783947587.453960:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb299c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.453969:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb299c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.453981:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb299c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.453999:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb299c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.454006:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb299c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.454013:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1ba00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947587.454017:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb299c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.454025:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb299c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.454034:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281b500) 00010000:00010000:1.0:1783947587.454037:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947587.454040:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb299c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.454046:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb299c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.454057:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb298e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.454069:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb298e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.454074:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb298e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.454079:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947587.454082:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb298e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.454087:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb298e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.454094:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281b500) 00010000:00010000:1.0:1783947587.454096:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783947587.454099:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb298e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.454104:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb298e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947587.454345:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c8797b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+20:11504:x1870604297912320:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 25278us (25561us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1783947587.454355:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 186 00000020:00080000:1.0:1783947587.454358:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783947587.454812:0:12326:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947587.454818:0:12326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947587.454849:0:12326:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1783947587.454855:0:12326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1783947587.456249:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783947587.456255:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783947587.456770:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1783947587.456777:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783947587.475032:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947587.475230:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297912832 00000100:00100000:1.0:1783947587.475242:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297912832 00000100:00100000:1.0:1783947587.475310:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:1.0:1783947587.475322:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+20:11504:x1870604297912832:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783947587.476098:0:5800:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783947587.476206:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1783947587.476256:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb29a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.476274:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb29a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.476285:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb29a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.476293:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb29a3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.476301:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb29a3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.476306:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb29a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.476345:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783947587.476475:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+22:11504:x1870604297912832:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 1153us (1462us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1783947587.476484:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 50 00000020:00080000:1.0:1783947587.476489:0:5800:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783947587.476806:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947587.476816:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb29a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.476837:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73ae00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:2.0:1783947587.476841:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb29a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.476849:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb29a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.476862:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b3c82977600) 00010000:00010000:2.0:1783947587.476865:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783947587.476870:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb29a3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.476875:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb29a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.476893:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947587.476894:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947587.476896:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947587.611717:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947587.612035:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297913088 00000100:00100000:1.0:1783947587.612045:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297913088 00000100:00100000:1.0:1783947587.612109:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 187 00000100:00100000:1.0:1783947587.612119:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+22:11514:x1870604297913088:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1783947587.612142:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947587.612174:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb29aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab2a4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.612463:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb29b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.612479:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb29b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.612491:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb29b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947587.612503:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1783947587.612706:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb29aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2a4 expref: 25 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.612723:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb29b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2a4 expref: 24 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.612732:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:1.0:1783947587.612735:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783947587.612739:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73ae00, rc 0) 00000100:00100000:1.0:1783947587.612797:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:11514:x1870604297913088:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 680us (1092us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1783947587.612805:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 187 00000100:00100000:3.0:1783947587.620449:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947587.620557:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297913216 00000100:00100000:1.0:1783947587.620567:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297913216 00000100:00100000:1.0:1783947587.620628:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 188 00000100:00100000:1.0:1783947587.620640:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:11514:x1870604297913216:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:1.0:1783947587.620730:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb29bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.620747:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb29bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.620759:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb29bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.620776:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb29c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.620785:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb29c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.620792:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb29c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621117:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621127:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621136:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947587.621176:0:6613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621189:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb29bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621206:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb29bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621214:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb29bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621221:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947587.621226:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb29bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621233:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb29bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621245:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:1.0:1783947587.621248:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947587.621253:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb29bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621260:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb29bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621271:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb29c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621278:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb29c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621285:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb29c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621291:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73bc00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947587.621302:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb29c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621309:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb29c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621317:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b3c82977900) 00010000:00010000:1.0:1783947587.621320:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947587.621323:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb29c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621330:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb29c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621347:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621354:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621360:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621366:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947587.621369:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621375:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621383:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c82977d00) 00010000:00010000:1.0:1783947587.621385:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947587.621397:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.621404:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947587.621632:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:11514:x1870604297913216:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 993us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947587.621642:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 188 00000100:00100000:0.0:1783947587.686157:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947587.686200:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297913472 00000100:00100000:0.0:1783947587.686210:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297913472 00000100:00100000:0.0:1783947587.686257:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 189 00000100:00100000:0.0:1783947587.686267:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:11517:x1870604297913472:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1783947587.686287:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947587.686307:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb29d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab2ab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.686377:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb29db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.686392:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb29db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.686403:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb29db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.686441:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb29e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.686449:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb29e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.686457:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb29e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.686780:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb29e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.686790:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb29e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.686809:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb29e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947587.686820:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1783947587.686911:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb29db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.686919:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb29db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.686926:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb29db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.686932:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947587.686936:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb29db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.686943:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb29db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.686955:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:0.0:1783947587.686959:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947587.686963:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb29db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.686969:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670000/0x20c3e53e78bb29db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.686993:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb29e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.687000:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb29e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.687149:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb29e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.687155:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947587.687159:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb29e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.687166:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb29e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.687174:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b3c8281b900) 00010000:00010000:0.0:1783947587.687176:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947587.687180:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb29e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947587.687186:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670600/0x20c3e53e78bb29e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.688470:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb29d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2ab expref: 27 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.688496:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb29e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2ab expref: 26 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.688505:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:1.0:1783947587.688508:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947587.688510:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671200, rc 0) 00000100:00100000:1.0:1783947587.688573:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+26:11517:x1870604297913472:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 2307us (2426us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1783947587.688581:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 189 00000100:00100000:1.0:1783947587.706893:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947587.709545:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297913600 00000100:00100000:0.0:1783947587.709560:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297913600 00000100:00100000:1.0:1783947587.709856:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 190 00000100:00100000:1.0:1783947587.709867:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+26:11517:x1870604297913600:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:1.0:1783947587.709935:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.709951:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.709975:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.710022:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.710030:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.710036:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.710043:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947587.710047:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.710055:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.710066:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:1.0:1783947587.710070:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947587.710073:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.710080:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947587.710306:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+26:11517:x1870604297913600:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 440us (3418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947587.710315:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 190 00000100:00100000:0.0:1783947587.713563:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947587.714076:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297913856 00000100:00100000:2.0:1783947587.714085:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297913856 00000100:00100000:2.0:1783947587.714177:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:2.0:1783947587.714187:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+26:11517:x1870604297913856:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1783947587.714408:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+27:11517:x1870604297913856:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 222us (854us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1783947587.714451:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:0.0:1783947587.777880:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947587.777980:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297914112 00000100:00100000:1.0:1783947587.778084:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297914112 00000100:00100000:1.0:1783947587.778151:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 191 00000100:00100000:1.0:1783947587.778161:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+27:11051:x1870604297914112:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1783947587.778187:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947587.778209:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab2b2 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.778305:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2a05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.778319:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb29e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2ab expref: 28 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.778328:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2a05 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.778359:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb29e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2ab expref: 28 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.778378:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb29e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2ab expref: 28 pid: 5798 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947587.778391:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aeea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5795:1870604319927936:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947587.778529:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b85d930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947587.783093:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aeea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5795:1870604319927936:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947587.783121:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2a05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947587.784673:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947587.785191:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297914240 00000100:00100000:2.0:1783947587.785200:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297914240 00010000:00010000:2.0:1783947587.785241:0:8318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb29e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2ab expref: 29 pid: 5798 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947587.785307:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 72 00000100:00100000:2.0:1783947587.785318:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+29:2354:x1870604297914240:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947587.785333:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947587.785340:0:8318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb29e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2ab expref: 29 pid: 5798 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.785353:0:8318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb29e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2ab expref: 29 pid: 5798 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.785376:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671200/0x20c3e53e78bb29e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2ab expref: 29 pid: 5798 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.785394:0:8318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:2.0:1783947587.785400:0:8318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2a05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.785409:0:8318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2a05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.785450:0:8318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2a05 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.785483:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947587.785532:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+28:2354:x1870604297914240:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 217us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947587.785540:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 72 00010000:00010000:1.0:1783947587.785946:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2a05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.785963:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2a05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947587.785981:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1783947587.786213:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb29fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2b2 expref: 29 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.786228:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2a05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2b2 expref: 28 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.786235:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:1.0:1783947587.786238:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783947587.786240:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73bc00, rc 0) 00000100:00100000:1.0:1783947587.786390:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+28:11051:x1870604297914112:12345-192.168.203.32@tcp:101:bash.0 Request processed in 8229us (8518us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1783947587.786398:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 191 00000100:00100000:3.0:1783947587.796958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947587.797103:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297914496 00000100:00100000:2.0:1783947587.797126:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297914496 00000100:00100000:2.0:1783947587.797185:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 192 00000100:00100000:2.0:1783947587.797196:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+28:11051:x1870604297914496:12345-192.168.203.32@tcp:36:bash.0 00010000:00010000:2.0:1783947587.797497:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2a13 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.797515:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2a13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.797526:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2a13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783947587.797578:0:6613:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1783947587.797603:0:6613:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007201cb90 reply state 000000008c93ade7 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2a13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947587.797612:0:6613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1783947587.797661:0:6613:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1783947587.797754:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+32:11051:x1870604297914496:12345-192.168.203.32@tcp:36:bash.0 Request processed in 559us (804us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1783947587.797761:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 192 00000020:00080000:2.0:1783947587.797766:0:6613:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1783947587.803914:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947587.804534:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297914624 00000100:00100000:1.0:1783947587.804545:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297914624 00000100:00100000:1.0:1783947587.804604:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 193 00000100:00100000:1.0:1783947587.804614:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+32:11051:x1870604297914624:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1783947587.804639:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947587.804660:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2a1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab2b9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.804736:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2a1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2b9 expref: 33 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.804771:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2a1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2b9 expref: 33 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947587.804792:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:1.0:1783947587.804795:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783947587.804799:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a800, rc 0) 00000100:00100000:1.0:1783947587.804865:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+33:11051:x1870604297914624:12345-192.168.203.32@tcp:101:bash.0 Request processed in 252us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947587.804873:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 193 00010000:00010000:2.0:1783947587.806055:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2a13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.806068:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2a13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.806074:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2a13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.806081:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631a00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947587.806097:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2a13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.806105:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2a13 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.806117:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:2.0:1783947587.806121:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947587.806125:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2a13 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947587.806131:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2a13 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947587.812464:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947587.812547:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297914752 00000100:00100000:3.0:1783947587.812568:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297914752 00000100:00100000:3.0:1783947587.812619:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 58 00000100:00100000:3.0:1783947587.812629:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:11051:x1870604297914752:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1783947587.812647:0:8151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947587.812680:0:8151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2a21 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab2c0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947587.812707:0:8151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a54e141, atime: 0x6a54e13f, ctime: 0x6a54e141, blocks: 0xb 00010000:00010000:3.0:1783947587.812726:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=403s v=(0 0) 00010000:00010000:3.0:1783947587.812731:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947587.812738:0:8151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2a21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2c0 expref: 8 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.812756:0:8151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2a21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2c0 expref: 8 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.812769:0:8151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1ae00, rc 0) 00000100:00100000:3.0:1783947587.812817:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:11051:x1870604297914752:12345-192.168.203.32@tcp:101:bash.0 Request processed in 190us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947587.812824:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 58 00000100:00100000:0.0:1783947587.821857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947587.821957:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297914880 00000100:00100000:1.0:1783947587.821967:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297914880 00002000:00010000:1.0:1783947587.822029:0:6595:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1783947587.822035:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3b85bc7100 with x1870604297914880 ext(0->18446744073709551615) 00002000:00010000:1.0:1783947587.822046:0:6595:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b3b85bc7100. 00000100:00100000:1.0:1783947587.822081:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:1.0:1783947587.822093:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2354:x1870604297914880:12345-192.168.203.32@tcp:10:bash.0 00002000:00010000:1.0:1783947587.822594:0:6595:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1783947587.822648:0:6595:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1783947585 -> 1783947587 00002000:00010000:1.0:1783947587.822651:0:6595:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1783947583 -> 1783947583 00002000:00010000:1.0:1783947587.822654:0:6595:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783947585 -> 1783947587 00002000:00010000:1.0:1783947587.822656:0:6595:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1783947587.822763:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2354:x1870604297914880:12345-192.168.203.32@tcp:10:bash.0 Request processed in 670us (914us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1783947587.822772:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00002000:00010000:1.0:1783947587.822947:0:6595:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1783947587.822964:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3b85bc7100 with x1870604297914880 ext(0->18446744073709551615) 00002000:00010000:1.0:1783947587.822970:0:6595:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b3b85bc7100. 00000100:00100000:1.0:1783947587.849517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947587.849567:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947587.849661:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297915008 00000100:00100000:2.0:1783947587.849683:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297915008 00002000:00100000:2.0:1783947587.849733:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->7) req@ffff8b3cb6aeea00 x1870604297915008/t0(0) o4->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:378/0 lens 496/0 e 0 to 0 dl 1783947598 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783947587.849744:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3cb6aeea00 with x1870604297915008 ext(0->7) 00002000:00010000:2.0:1783947587.849750:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b3cb6aeea00 00000100:00100000:2.0:1783947587.849783:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:2.0:1783947587.849792:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2356:x1870604297915008:12345-192.168.203.32@tcp:4:bash.0 00000100:00100000:2.0:1783947587.850594:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+11:2356:x1870604297915008:12345-192.168.203.32@tcp:4:bash.0 Request processed in 799us (1083us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1783947587.850603:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00002000:00100000:2.0:1783947587.850612:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->7) req@ffff8b3cb6aeea00 x1870604297915008/t4294967319(0) o4->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:378/0 lens 496/448 e 0 to 0 dl 1783947598 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783947587.850621:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3cb6aeea00 with x1870604297915008 ext(0->7) 00002000:00010000:2.0:1783947587.850632:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b3cb6aeea00 00000100:00100000:0.0:1783947587.850711:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297915136 00000100:00100000:0.0:1783947587.850717:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297915136 00000100:00100000:0.0:1783947587.850748:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:0.0:1783947587.850756:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+11:2356:x1870604297915136:12345-192.168.203.32@tcp:16:kworker.0 00010000:00010000:0.0:1783947587.910373:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947587.921818:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947587.922031:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297915264 00000100:00100000:3.0:1783947587.922041:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297915264 00000100:00100000:3.0:1783947587.922105:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 194 00000100:00100000:3.0:1783947587.922115:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+32:11531:x1870604297915264:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:3.0:1783947587.922194:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2a28 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922226:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2a28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922238:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2a28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922252:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2a2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922259:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922265:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922550:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2a36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922559:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922566:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783947587.922603:0:6613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922613:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2a28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922619:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2a28 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922634:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2a28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922640:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947587.922644:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2a28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922651:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2a28 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922661:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:3.0:1783947587.922664:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947587.922668:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2a28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922674:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2a28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922685:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922691:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2a2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922696:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2a2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922700:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947587.922702:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2a2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922716:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2a2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922723:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b3c84af9d00) 00010000:00010000:3.0:1783947587.922725:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947587.922728:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2a2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922734:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2a2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922747:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922753:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2a36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922758:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2a36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922763:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947587.922765:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2a36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922770:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2a36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922776:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:3.0:1783947587.922778:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947587.922781:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2a36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947587.922795:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2a36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947587.922877:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+32:11531:x1870604297915264:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 762us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947587.922885:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 194 00000001:00080000:2.0:1783947587.926328:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:2.0:1783947587.926347:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1783947587.926365:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:2.0:1783947587.926384:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000100:00100000:0.0:1783947587.927450:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2356:x1870604297915136:12345-192.168.203.32@tcp:16:kworker.0 Request processed in 76686us (77873us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947587.927462:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:0.0:1783947588.012789:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947588.012900:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297915520 00000100:00100000:1.0:1783947588.012911:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297915520 00000100:00100000:1.0:1783947588.013032:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 195 00000100:00100000:1.0:1783947588.013043:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+32:11534:x1870604297915520:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1783947588.013067:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947588.013090:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2a3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab2c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013179:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2a44 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013196:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2a44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013208:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2a44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013225:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2a4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013234:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013241:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013654:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2a52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013668:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013675:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947588.013685:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783947588.013783:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2a44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013792:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2a44 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013798:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2a44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013805:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947588.013809:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2a44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013818:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2a44 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013830:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:1.0:1783947588.013833:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947588.013837:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2a44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013844:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb2a44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013856:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013871:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2a4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013877:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2a4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013883:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947588.013886:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2a4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013893:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2a4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013902:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b3c82977d00) 00010000:00010000:1.0:1783947588.013904:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947588.013907:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2a4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013913:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb2a4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013958:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b400/0x20c3e53e78bb2a3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2c7 expref: 35 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013972:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2a52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2c7 expref: 34 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.013992:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:1.0:1783947588.013994:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783947588.014003:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cbd825400, rc 0) 00000100:00100000:1.0:1783947588.014068:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+34:11534:x1870604297915520:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1027us (1288us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1783947588.014076:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 195 00000100:00100000:3.0:1783947588.022619:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947588.028146:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297915648 00000100:00100000:2.0:1783947588.028162:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297915648 00000100:00100000:2.0:1783947588.028240:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 196 00000100:00100000:2.0:1783947588.028251:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+34:11534:x1870604297915648:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:2.0:1783947588.028331:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2a60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.028350:0:6613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2a05 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2b2 expref: 34 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.028368:0:6613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2a60 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.028412:0:6613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2a05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2b2 expref: 34 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.028468:0:6613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2a05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2b2 expref: 34 pid: 5795 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947588.028485:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b856ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6613:1870604319928064:192.168.203.32@tcp:104: 00000100:00100000:2.0:1783947588.028579:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87ec6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783947588.031844:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b856ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6613:1870604319928064:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947588.031873:0:6613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2a60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947588.032731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947588.032807:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297915904 00000100:00100000:1.0:1783947588.032815:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297915904 00000100:00100000:1.0:1783947588.032866:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:1.0:1783947588.032875:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb660b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+35:5570:x1870604297915904:12345-192.168.203.32@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783947588.033209:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb660b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+36:5570:x1870604297915904:12345-192.168.203.32@tcp:35:ldlm_bl.0 Request processed in 333us (481us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1783947588.033217:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:2.0:1783947588.043370:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947588.043564:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297916032 00000100:00100000:3.0:1783947588.043575:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297916032 00010000:00010000:3.0:1783947588.043615:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2a05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2b2 expref: 36 pid: 5795 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947588.043701:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00100000:3.0:1783947588.043712:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+36:2354:x1870604297916032:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947588.043728:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947588.043736:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2a05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2b2 expref: 36 pid: 5795 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.043749:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2a05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2b2 expref: 36 pid: 5795 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.043772:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb2a05 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2b2 expref: 36 pid: 5795 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.043803:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:3.0:1783947588.043809:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2a60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.043818:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.043825:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2a60 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.043860:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947588.043921:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+35:2354:x1870604297916032:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 212us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947588.043928:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 73 00010000:00010000:0.0:1783947588.043997:0:6613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.044015:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.044046:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.044053:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2a60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.044059:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2a60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.044065:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947588.044069:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2a60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.044077:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2a60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.044087:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:0.0:1783947588.044089:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783947588.044101:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2a60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.044107:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2a60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947588.044160:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+34:11534:x1870604297915648:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 15911us (21552us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947588.044168:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 196 00000100:00100000:0.0:1783947588.056871:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947588.057550:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297916288 00000100:00100000:2.0:1783947588.057575:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297916288 00000100:00100000:2.0:1783947588.058514:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:2.0:1783947588.058531:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+34:11534:x1870604297916288:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1783947588.058776:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+35:11534:x1870604297916288:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 251us (1914us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1783947588.058784:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:3.0:1783947588.174464:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947588.174619:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297916544 00000100:00100000:0.0:1783947588.174629:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297916544 00000100:00100000:0.0:1783947588.174686:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 197 00000100:00100000:0.0:1783947588.174698:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+35:11545:x1870604297916544:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:0.0:1783947588.174722:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947588.174742:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2a67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab2ce expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.174815:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2a6e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.174829:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2a6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.174841:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2a6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.174856:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2a75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.174863:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.174884:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.175237:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2a7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.175247:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.175254:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947588.175264:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1783947588.175577:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2a6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.175586:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2a6e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.175592:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2a6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.175598:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947588.175603:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2a6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.175610:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2a6e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.175623:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:0.0:1783947588.175626:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947588.175638:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2a6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.175646:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671000/0x20c3e53e78bb2a6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.175663:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.175670:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2a75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.175676:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2a75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.175680:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947588.175683:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2a75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.175689:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2a75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.175697:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b3c8281b900) 00010000:00010000:0.0:1783947588.175699:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947588.175702:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2a75 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.175708:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2a75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.175754:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2a67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2ce expref: 38 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.175782:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2a7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2ce expref: 37 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.175789:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:0.0:1783947588.175792:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947588.175794:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670e00, rc 0) 00000100:00100000:0.0:1783947588.175860:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+37:11545:x1870604297916544:12345-192.168.203.32@tcp:101:cat.0 Request processed in 1164us (1404us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1783947588.175868:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 197 00000100:00100000:1.0:1783947588.186098:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947588.187049:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297916800 00000100:00100000:0.0:1783947588.187061:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297916800 00000100:00100000:0.0:1783947588.187122:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:0.0:1783947588.187133:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+37:11545:x1870604297916800:12345-192.168.203.32@tcp:35:cat.0 00000100:00100000:0.0:1783947588.187886:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+38:11545:x1870604297916800:12345-192.168.203.32@tcp:35:cat.0 Request processed in 217us (1270us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1783947588.187900:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:0.0:1783947588.213107:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947588.213183:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297917056 00000100:00100000:1.0:1783947588.213193:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297917056 00000100:00100000:1.0:1783947588.213249:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 198 00000100:00100000:1.0:1783947588.213259:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+38:11546:x1870604297917056:12345-192.168.203.32@tcp:36:rm.0 00010000:00010000:1.0:1783947588.213318:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783947588.213345:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2a7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2ce expref: 38 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.213446:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2a52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2c7 expref: 37 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.213459:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb2a1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2b9 expref: 36 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.213469:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c8281bc00) 00010000:00010000:1.0:1783947588.213486:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947588.213506:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825000/0x20c3e53e78bb2a8a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.213517:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825000/0x20c3e53e78bb2a8a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.213527:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825000/0x20c3e53e78bb2a8a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.213538:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2a91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.213545:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2a91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.213551:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2a91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.213819:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2a98 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.213828:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2a98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.213834:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2a98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783947588.216815:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1783947588.216830:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 403487411444ns, next at 404487407993ns, rc = 0 00010000:00010000:0.0:1783947588.216914:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2a9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.216931:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2a9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.216941:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2a9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.216960:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2a9f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.216966:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2a9f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.216972:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2a9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.217001:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947588.217024:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2a98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.217030:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2a98 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.217035:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2a98 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.217040:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd824200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947588.217045:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2a98 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.217052:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2a98 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.217063:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c82977900) 00010000:00010000:0.0:1783947588.217066:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783947588.217070:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2a98 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.217086:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2a98 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.217104:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825000/0x20c3e53e78bb2a8a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.217109:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825000/0x20c3e53e78bb2a8a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.217115:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825000/0x20c3e53e78bb2a8a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.217120:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd825000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947588.217124:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825000/0x20c3e53e78bb2a8a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.217129:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825000/0x20c3e53e78bb2a8a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.217149:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:0.0:1783947588.217152:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947588.217155:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825000/0x20c3e53e78bb2a8a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.217160:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825000/0x20c3e53e78bb2a8a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947588.217171:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003bfe641a reply state 000000008b032296 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2a91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947588.217180:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783947588.217268:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+37:11546:x1870604297917056:12345-192.168.203.32@tcp:36:rm.0 Request processed in 4007us (4165us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1783947588.217280:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 198 00010000:00010000:1.0:1783947588.218122:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947588.218139:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2a9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.218147:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670200 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947588.218159:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2a9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.218166:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2a9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.218177:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b3c82977900) 00010000:00010000:1.0:1783947588.218180:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783947588.218184:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2a9f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.218190:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2a9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.218209:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947588.218212:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947588.218213:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947588.226939:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2a91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.226955:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2a91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.226963:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2a91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.226969:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd825800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947588.226974:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2a91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.226992:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2a91 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.227026:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b3c82977d00) 00010000:00010000:1.0:1783947588.227029:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947588.227033:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2a91 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.227039:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2a91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783947588.230732:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1783947588.230755:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:0.0:1783947588.299085:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947588.299332:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297917312 00000100:00100000:3.0:1783947588.299342:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297917312 00000100:00100000:3.0:1783947588.299401:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 199 00000100:00100000:3.0:1783947588.299411:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+36:11552:x1870604297917312:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1783947588.299467:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947588.299489:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2aa6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab2d5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.299604:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2aad lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.299637:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2aad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.299649:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2aad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.299666:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2ab4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.299674:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2ab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.299681:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2ab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783947588.300199:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1783947588.300342:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2abb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.300352:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.300360:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.300390:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2aad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.300397:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2aad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.300403:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2aad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.300415:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947588.300448:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2aad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.300456:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2aad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.300468:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:3.0:1783947588.300471:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947588.300475:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2aad lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.300482:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a600/0x20c3e53e78bb2aad lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783947588.300495:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f40c509c reply state 000000002563199e transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2ab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947588.300504:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783947588.300532:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2aa6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2d5 expref: 39 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.300544:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2abb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2d5 expref: 38 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.300552:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84af9800) 00010000:00010000:3.0:1783947588.300554:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947588.300557:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1ba00, rc 0) 00000100:00100000:3.0:1783947588.300623:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+39:11552:x1870604297917312:12345-192.168.203.32@tcp:101:bash.0 Request processed in 1213us (1547us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1783947588.300637:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 199 00010000:00010000:2.0:1783947588.303768:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2ab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.303785:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2ab4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.303792:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2ab4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.303799:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947588.303803:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2ab4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.303811:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2ab4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.303826:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b3c84af9d00) 00010000:00010000:2.0:1783947588.303829:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947588.303833:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2ab4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.303840:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2ab4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947588.305881:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947588.306116:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297917440 00000100:00100000:3.0:1783947588.306126:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297917440 00000100:00100000:3.0:1783947588.306205:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:3.0:1783947588.306216:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2354:x1870604297917440:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1783947588.306233:0:8151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947588.306255:0:8151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2ac9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab2dc expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947588.306280:0:8151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947588.306300:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=403s v=(0 0) 00010000:00010000:3.0:1783947588.306305:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947588.306313:0:8151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2ac9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2dc expref: 6 pid: 8151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.306332:0:8151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2ac9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2dc expref: 6 pid: 8151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.306344:0:8151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147ca00, rc 0) 00000100:00100000:3.0:1783947588.306451:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297917440:12345-192.168.203.32@tcp:101:bash.0 Request processed in 203us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947588.306458:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00080000:2.0:1783947588.306649:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947588.310290:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947588.312285:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297917568 00000100:00100000:1.0:1783947588.312298:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297917568 00000100:00100000:1.0:1783947588.312590:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:1.0:1783947588.312602:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:11552:x1870604297917568:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1783947588.312620:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947588.312636:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004ea367d/0x20c3e53e78bb2ad0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab2e3 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.312667:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2ac9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2dc expref: 7 pid: 8151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.312676:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947588.312680:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947588.312685:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004ea367d/0x20c3e53e78bb2ad0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2e3 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.312719:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2ac9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2dc expref: 7 pid: 8151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.312751:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2ac9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2dc expref: 7 pid: 8151 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947588.312765:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1870604319928192:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947588.312843:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb61a7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783947588.315103:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1870604319928192:192.168.203.32@tcp:104: 00010000:00010000:2.0:1783947588.315150:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000004ea367d/0x20c3e53e78bb2ad0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2e3 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.315171:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cbd825400, rc 0) 00000100:00100000:2.0:1783947588.315229:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:11552:x1870604297917568:12345-192.168.203.32@tcp:101:bash.0 Request processed in 2629us (4948us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947588.316071:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947588.316555:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297917696 00000100:00100000:1.0:1783947588.316563:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297917696 00010000:00010000:1.0:1783947588.316600:0:8318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2ac9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2dc expref: 8 pid: 8151 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947588.316638:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00100000:1.0:1783947588.316647:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd039880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2354:x1870604297917696:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947588.316660:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947588.316680:0:8318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2ac9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2dc expref: 8 pid: 8151 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.316693:0:8318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2ac9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2dc expref: 8 pid: 8151 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.316715:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2ac9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2dc expref: 8 pid: 8151 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.316730:0:8318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947588.316745:0:8318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947588.316754:0:8318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000004ea367d/0x20c3e53e78bb2ad0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2e3 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.316764:0:8318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004ea367d/0x20c3e53e78bb2ad0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2e3 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.316800:0:8318:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000004ea367d/0x20c3e53e78bb2ad0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2e3 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947588.316812:0:8318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8318:1870604319928320:192.168.203.32@tcp:105: 00000100:00100000:1.0:1783947588.316886:0:8318:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb61a7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947588.317306:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:1.0:1783947588.320890:0:8318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8318:1870604319928320:192.168.203.32@tcp:105: 00010000:00010000:1.0:1783947588.320915:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947588.320968:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd039880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2354:x1870604297917696:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 4322us (4901us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947588.320991:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00100000:0.0:1783947588.321149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947588.321246:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297917952 00000100:00100000:2.0:1783947588.321254:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297917952 00000100:00100000:2.0:1783947588.321303:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:2.0:1783947588.321313:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+38:11552:x1870604297917952:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:2.0:1783947588.321654:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+39:11552:x1870604297917952:12345-192.168.203.32@tcp:35:bash.0 Request processed in 342us (504us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1783947588.321661:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:0.0:1783947588.363497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947588.363692:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947588.363727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947588.363804:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297918336 00000100:00100000:0.0:1783947588.363813:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297918336 00000100:00100000:0.0:1783947588.363882:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 166 00000100:00100000:0.0:1783947588.363893:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2356:x1870604297918336:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947588.363907:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297918208 00000100:00100000:2.0:1783947588.363914:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297918208 00000100:00100000:0.0:1783947588.363962:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2356:x1870604297918336:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 72us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947588.363969:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 166 00000100:00100000:2.0:1783947588.364033:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 75 00000100:00100000:2.0:1783947588.364045:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2356:x1870604297918208:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947588.364078:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2356:x1870604297918208:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 36us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947588.364087:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 75 00000100:00080000:1.0:1783947588.364168:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947588.367547:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297918080 00000100:00100000:3.0:1783947588.367576:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297918080 00000100:00100000:0.0:1783947588.370359:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 299 00000100:00100000:0.0:1783947588.370373:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:2356:x1870604297918080:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947588.370478:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:2356:x1870604297918080:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 107us (6990us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947588.370486:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 299 00000100:00100000:1.0:1783947588.522775:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947588.522957:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297918464 00000100:00100000:3.0:1783947588.522972:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297918464 00000100:00100000:3.0:1783947588.523068:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 200 00000100:00100000:3.0:1783947588.523081:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c84f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+39:11568:x1870604297918464:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1783947588.523117:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947588.523159:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb2ad7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab2ea expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.523252:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2ade lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.523271:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.523285:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947588.523372:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1783947588.523377:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947588.523410:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.523521:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb2ad7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2ea expref: 41 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.523551:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2ea expref: 40 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.523562:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:3.0:1783947588.523585:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947588.523590:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147d600, rc 0) 00000100:00100000:3.0:1783947588.523667:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c84f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+40:11568:x1870604297918464:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 589us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947588.523676:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 200 00000100:00100000:3.0:1783947588.527026:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947588.527143:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297918720 00000100:00100000:0.0:1783947588.527164:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297918720 00000100:00100000:0.0:1783947588.527254:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 201 00000100:00100000:0.0:1783947588.527265:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+40:11568:x1870604297918720:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1783947588.527287:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947588.527308:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2ae5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab2f1 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.527493:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2aec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.527509:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2aec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.527522:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2aec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947588.527533:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1783947588.527666:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2ae5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2f1 expref: 43 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.527687:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2aec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2f1 expref: 42 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.527696:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84af9800) 00010000:00010000:0.0:1783947588.527699:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947588.527702:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671e00, rc 0) 00000100:00100000:0.0:1783947588.527775:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+42:11568:x1870604297918720:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 512us (765us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1783947588.527783:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 201 00000100:00100000:0.0:1783947588.531505:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947588.531740:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297918976 00000100:00100000:3.0:1783947588.531774:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297918976 00000100:00100000:3.0:1783947588.531862:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 202 00000100:00100000:3.0:1783947588.531875:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+42:11568:x1870604297918976:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1783947588.531913:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947588.531946:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb2afa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab2f8 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.532101:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb2b01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.532120:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb2b01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.532600:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb2b01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947588.532627:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783947588.533394:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb2afa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2f8 expref: 45 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.533623:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb2b01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2f8 expref: 44 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.533660:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84af9800) 00010000:00010000:3.0:1783947588.533664:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783947588.533668:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147ca00, rc 0) 00000100:00100000:3.0:1783947588.533779:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+44:11568:x1870604297918976:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1906us (2284us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1783947588.533789:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 202 00000100:00100000:1.0:1783947588.541216:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947588.545940:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297919104 00000100:00100000:3.0:1783947588.545961:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297919104 00000100:00100000:3.0:1783947588.546235:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:3.0:1783947588.546251:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+44:2355:x1870604297919104:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947588.546275:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947588.546316:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2aec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2f1 expref: 44 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947588.546335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947588.546401:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297919232 00000100:00100000:0.0:1783947588.546440:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297919232 00000100:00100000:0.0:1783947588.546497:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:0.0:1783947588.546507:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+6:2353:x1870604297919232:12345-192.168.203.32@tcp:1:lfs.0 00010000:00010000:0.0:1783947588.546570:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb2b0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.546590:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004ea367d/0x20c3e53e78bb2ad0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2e3 expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.546611:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947588.546615:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783947588.546620:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb2b0f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.546657:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004ea367d/0x20c3e53e78bb2ad0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2e3 expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.546670:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004ea367d/0x20c3e53e78bb2ad0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2e3 expref: 6 pid: 6590 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947588.546685:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1870604319928448:192.168.203.32@tcp:104: 00000100:00100000:0.0:1783947588.546770:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87ec6000 going to sleep for 11 seconds 00010000:00010000:3.0:1783947588.548247:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84af9800) 00010000:00010000:3.0:1783947588.548262:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947588.548446:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+43:2355:x1870604297919104:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 2173us (7212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947588.548525:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:1.0:1783947588.556736:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947588.556866:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1870604319928448:192.168.203.32@tcp:104: 00010000:00010000:0.0:1783947588.556893:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb2b0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947588.556989:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297919360 00000100:00100000:2.0:1783947588.556998:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297919360 00002000:00100000:2.0:1783947588.557055:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8b3cb60a0700 x1870604297919360/t0(0) o4->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:379/0 lens 504/0 e 0 to 0 dl 1783947599 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783947588.557078:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3cb60a0700 with x1870604297919360 ext(0->8) 00010000:00010000:2.0:1783947588.557086:0:6595:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000004ea367d/0x20c3e53e78bb2ad0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2e3 expref: 7 pid: 6590 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.557101:0:6595:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000004ea367d/0x20c3e53e78bb2ad0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2e3 expref: 7 pid: 6590 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783947588.557109:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b3cb60a0700 00000100:00100000:2.0:1783947588.557145:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:2.0:1783947588.557154:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2354:x1870604297919360:12345-192.168.203.32@tcp:4:lfs.0 00000100:00100000:2.0:1783947588.557919:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2354:x1870604297919360:12345-192.168.203.32@tcp:4:lfs.0 Request processed in 761us (1189us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783947588.557928:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00002000:00100000:2.0:1783947588.557937:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8b3cb60a0700 x1870604297919360/t4294967308(0) o4->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:379/0 lens 504/448 e 0 to 0 dl 1783947599 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783947588.557946:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3cb60a0700 with x1870604297919360 ext(0->8) 00010000:00010000:2.0:1783947588.557953:0:6595:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000004ea367d/0x20c3e53e78bb2ad0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2e3 expref: 9 pid: 6590 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.557967:0:6595:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000004ea367d/0x20c3e53e78bb2ad0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2e3 expref: 9 pid: 6590 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783947588.557976:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b3cb60a0700 00000100:00100000:1.0:1783947588.564659:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947588.564812:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297919488 00000100:00100000:3.0:1783947588.564823:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297919488 00010000:00010000:3.0:1783947588.564865:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004ea367d/0x20c3e53e78bb2ad0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2e3 expref: 9 pid: 6590 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947588.564909:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 75 00000100:00100000:3.0:1783947588.564932:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2353:x1870604297919488:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947588.564946:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1783947588.564964:0:5784:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783947588.564967:0:5784:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783947587 00002000:00010000:3.0:1783947588.564969:0:5784:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783947587 00002000:00010000:3.0:1783947588.564971:0:5784:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1783947587 00010000:00010000:3.0:1783947588.564990:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004ea367d/0x20c3e53e78bb2ad0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2e3 expref: 9 pid: 6590 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.565010:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004ea367d/0x20c3e53e78bb2ad0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2e3 expref: 9 pid: 6590 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.565032:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004ea367d/0x20c3e53e78bb2ad0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2e3 expref: 9 pid: 6590 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.565050:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783947588.565054:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783947588.565059:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb2b0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.565070:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb2b0f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.565163:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947588.565220:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2353:x1870604297919488:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 289us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947588.565238:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 75 00010000:00010000:0.0:1783947588.571378:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb2b0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947588.571540:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb2b0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.577560:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb2b0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.577611:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb2b0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.577621:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb2b0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.577628:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670600 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947588.577634:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb2b0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.577644:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb2b0f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.577667:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb2b0f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.577675:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f95b1bfb/0x20c3e53e78bb2b0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947588.577865:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2353:x1870604297919232:12345-192.168.203.32@tcp:1:lfs.0 Request processed in 31353us (31540us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947588.577876:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:1.0:1783947588.585660:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947588.585748:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297919744 00000100:00100000:2.0:1783947588.585773:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297919744 00000100:00100000:2.0:1783947588.585830:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00100000:2.0:1783947588.585841:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85b99c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+43:11568:x1870604297919744:12345-192.168.203.32@tcp:35:lfs.0 00000004:00010000:2.0:1783947588.585908:0:5800:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb2b01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2f8 expref: 43 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783947588.586250:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1783947588.586302:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1783947588.586661:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1783947588.586717:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b16 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.586733:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2abb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2d5 expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.586743:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b16 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.586777:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2abb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2d5 expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.586792:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2abb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2d5 expref: 47 pid: 5795 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947588.586806:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b856ece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5800:1870604319928576:192.168.203.32@tcp:104: 00000100:00100000:2.0:1783947588.586902:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c84c963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947588.589924:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b856ece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5800:1870604319928576:192.168.203.32@tcp:104: 00010000:00010000:2.0:1783947588.589952:0:5800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b16 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947588.591502:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947588.591661:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297919872 00000100:00100000:3.0:1783947588.591734:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297919872 00010000:00010000:3.0:1783947588.591775:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2abb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2d5 expref: 48 pid: 5795 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947588.591816:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 76 00000100:00100000:3.0:1783947588.591825:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+48:2354:x1870604297919872:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947588.591842:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947588.591849:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2abb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2d5 expref: 48 pid: 5795 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.591863:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2abb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2d5 expref: 48 pid: 5795 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.591888:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2abb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2d5 expref: 48 pid: 5795 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.591905:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84af9800) 00010000:00010000:3.0:1783947588.591911:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b16 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.591921:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.591928:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b16 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.591957:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947588.591993:0:5800:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.592001:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947588.592023:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+47:2354:x1870604297919872:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 199us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947588.592041:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 76 00000001:00080000:2.0:1783947588.592127:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1783947588.592354:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1783947588.592489:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b856ece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1870604319928704:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783947588.592537:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947588.592574:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c84c96180 going to sleep for 11 seconds 00000100:00100000:1.0:1783947588.592625:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319928704 00000100:00100000:1.0:1783947588.592636:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319928704 00000100:00100000:1.0:1783947588.592685:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783947588.592693:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5800:x1870604319928704:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783947588.592768:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5800:x1870604319928704:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 76us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947588.592775:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783947588.592912:0:5800:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1783947588.592917:0:5800:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1783947588.592933:0:5800:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b3b85bc6300, transno 4294967307 00000100:00100000:2.0:1783947588.592952:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b856ece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1870604319928704:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783947588.595998:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1783947588.596097:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b856ece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1870604319928832:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783947588.596164:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947588.596205:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c84c963c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947588.597542:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319928832 00000100:00100000:1.0:1783947588.597554:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319928832 00000100:00100000:1.0:1783947588.597614:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783947588.597624:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5800:x1870604319928832:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783947588.597873:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5800:x1870604319928832:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 250us (1707us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1783947588.597881:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783947588.597960:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b856ece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1870604319928832:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783947588.598038:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1783947588.598085:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.598096:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b16 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.598104:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.598123:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947588.598128:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.598149:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b16 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.598165:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84af9800) 00010000:00010000:2.0:1783947588.598168:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783947588.598173:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b16 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.598180:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b16 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783947588.598402:0:5800:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783947588.598551:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1783947588.598564:0:5800:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 403869144484ns, next at 404869141957ns, rc = 0 00000001:00080000:2.0:1783947588.598570:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1783947588.598616:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84af9800) 00010000:00010000:2.0:1783947588.598620:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783947588.598626:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb2b01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2f8 expref: 51 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947588.598738:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85b99c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+50:11568:x1870604297919744:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 12898us (13089us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1783947588.598747:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 56 00000020:00080000:2.0:1783947588.598752:0:5800:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783947588.601261:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947588.601342:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297920000 00000100:00100000:2.0:1783947588.601351:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297920000 00000100:00100000:2.0:1783947588.601449:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 203 00000100:00100000:2.0:1783947588.601460:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+50:11568:x1870604297920000:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1783947588.601485:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947588.601509:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2b1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab2ff expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.601568:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2b1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2ff expref: 51 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.601585:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2b1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2ff expref: 51 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.601605:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:2.0:1783947588.601608:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947588.601612:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631800, rc 0) 00000100:00100000:2.0:1783947588.601677:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+51:11568:x1870604297920000:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 211us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947588.601684:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 203 00000100:00100000:0.0:1783947588.604942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947588.605058:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297920256 00000100:00100000:1.0:1783947588.605075:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297920256 00000100:00100000:1.0:1783947588.605133:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:1.0:1783947588.605144:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+51:11568:x1870604297920256:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1783947588.605392:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+52:11568:x1870604297920256:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 249us (459us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1783947588.605401:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:3.0:1783947588.741725:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947588.741811:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297920384 00000100:00100000:1.0:1783947588.741821:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297920384 00000100:00100000:1.0:1783947588.741881:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 204 00000100:00100000:1.0:1783947588.741891:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+52:11578:x1870604297920384:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:1.0:1783947588.741988:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824800/0x20c3e53e78bb2b24 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742017:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824800/0x20c3e53e78bb2b24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742032:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824800/0x20c3e53e78bb2b24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742048:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825a00/0x20c3e53e78bb2b2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742055:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825a00/0x20c3e53e78bb2b2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742062:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825a00/0x20c3e53e78bb2b2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742165:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742175:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742181:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947588.742220:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742233:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824800/0x20c3e53e78bb2b24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742240:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824800/0x20c3e53e78bb2b24 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742258:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824800/0x20c3e53e78bb2b24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742263:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd824800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947588.742268:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824800/0x20c3e53e78bb2b24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742276:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824800/0x20c3e53e78bb2b24 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742287:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:1.0:1783947588.742290:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947588.742294:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824800/0x20c3e53e78bb2b24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742300:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824800/0x20c3e53e78bb2b24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742313:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825a00/0x20c3e53e78bb2b2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742318:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825a00/0x20c3e53e78bb2b2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742323:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825a00/0x20c3e53e78bb2b2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742327:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd825a00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947588.742330:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825a00/0x20c3e53e78bb2b2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742345:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825a00/0x20c3e53e78bb2b2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742353:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b3c82977d00) 00010000:00010000:1.0:1783947588.742356:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947588.742358:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825a00/0x20c3e53e78bb2b2b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742364:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825a00/0x20c3e53e78bb2b2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742380:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742387:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742392:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742397:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd824000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947588.742399:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742405:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742411:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:1.0:1783947588.742413:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947588.742479:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.742496:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947588.742582:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+52:11578:x1870604297920384:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 692us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947588.742590:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 204 00000100:00100000:0.0:1783947588.812040:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947588.812242:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297920640 00000100:00100000:2.0:1783947588.812252:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297920640 00000100:00100000:2.0:1783947588.812327:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 205 00000100:00100000:2.0:1783947588.812337:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+52:11581:x1870604297920640:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1783947588.812358:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947588.812381:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab306 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.812629:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.812644:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.812654:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.812669:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2b47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.812677:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.812683:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.812808:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2b4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.812817:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.812823:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947588.812832:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783947588.812924:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.812931:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b40 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.812944:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.812949:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631a00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947588.812953:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.812959:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b40 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.812971:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:2.0:1783947588.812974:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947588.812989:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.812995:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.813008:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.813015:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2b47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.813020:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.813025:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630a00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947588.813028:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.813049:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2b47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.813057:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b3c84bc6500) 00010000:00010000:2.0:1783947588.813059:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947588.813062:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2b47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.813067:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2b47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.813106:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab306 expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.813119:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab306 expref: 54 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.813125:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:2.0:1783947588.813127:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947588.813129:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631e00, rc 0) 00000100:00100000:2.0:1783947588.813833:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+54:11581:x1870604297920640:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1493us (1798us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1783947588.813844:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 205 00000100:00100000:3.0:1783947588.818369:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947588.818457:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297920768 00000100:00100000:1.0:1783947588.818467:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297920768 00000100:00100000:1.0:1783947588.818532:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 206 00000100:00100000:1.0:1783947588.818542:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+54:11581:x1870604297920768:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:1.0:1783947588.818620:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.818637:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.818659:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.818688:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.818696:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.818703:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.818709:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd824000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947588.818713:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.818734:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.818747:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:1.0:1783947588.818749:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947588.818754:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.818760:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824000/0x20c3e53e78bb2b5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947588.819859:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+54:11581:x1870604297920768:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 1311us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947588.819871:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 206 00000100:00100000:3.0:1783947588.823338:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947588.823693:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297921024 00000100:00100000:1.0:1783947588.823704:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297921024 00000100:00100000:1.0:1783947588.823761:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 58 00000100:00100000:1.0:1783947588.823771:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+54:11581:x1870604297921024:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1783947588.824107:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+55:11581:x1870604297921024:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 336us (778us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1783947588.824115:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 58 00010000:00010000:0.0:1783947588.922022:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947588.935534:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947588.935689:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297921280 00000100:00100000:2.0:1783947588.935699:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297921280 00000100:00100000:2.0:1783947588.935768:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 207 00000100:00100000:2.0:1783947588.935779:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+55:11591:x1870604297921280:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1783947588.935820:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947588.935823:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783947588.935849:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2ade lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2ea expref: 55 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.935868:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:2.0:1783947588.935872:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947588.935887:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab30d expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.935988:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2b6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.936002:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.936011:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947588.936022:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783947588.936140:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab30d expref: 57 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.936154:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2b6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab30d expref: 56 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.936161:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:2.0:1783947588.936164:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947588.936167:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630a00, rc 0) 00000100:00100000:2.0:1783947588.936232:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+56:11591:x1870604297921280:12345-192.168.203.32@tcp:101:bash.0 Request processed in 454us (706us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1783947588.936240:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 207 00000100:00100000:0.0:1783947588.950500:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947588.950560:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947588.950667:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297921408 00000100:00100000:3.0:1783947588.950677:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297921408 00000100:00100000:3.0:1783947588.950753:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:3.0:1783947588.950763:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+56:2354:x1870604297921408:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947588.950779:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947588.950803:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb2b6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab30d expref: 56 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947588.950821:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:3.0:1783947588.950826:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947588.950879:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+55:2354:x1870604297921408:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 117us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947588.950886:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:2.0:1783947588.953960:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297921664 00000100:00100000:2.0:1783947588.953982:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297921664 00000100:00100000:2.0:1783947588.954152:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 208 00000100:00100000:2.0:1783947588.954164:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+55:11591:x1870604297921664:12345-192.168.203.32@tcp:36:bash.0 00010000:00010000:2.0:1783947588.954221:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947588.954247:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2b4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab306 expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.954264:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:2.0:1783947588.954269:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947588.954714:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.954728:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.954738:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783947588.954791:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1783947588.954816:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009a23d685 reply state 00000000df6d3384 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947588.954825:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783947588.955776:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+57:11591:x1870604297921664:12345-192.168.203.32@tcp:36:bash.0 Request processed in 1608us (5208us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1783947588.955788:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 208 00000020:00080000:2.0:1783947588.955808:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783947588.962448:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.962465:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.962473:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.962494:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947588.962499:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.962508:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.962524:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:1.0:1783947588.962527:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947588.962532:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b78 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947588.962538:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb2b78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947588.971749:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947588.972004:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297921792 00000100:00100000:2.0:1783947588.972015:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297921792 00000100:00100000:2.0:1783947588.972085:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 209 00000100:00100000:2.0:1783947588.972103:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+56:11591:x1870604297921792:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1783947588.972125:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947588.972156:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2b7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab314 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.972240:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.972254:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.972265:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947588.972292:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783947588.972297:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783947588.972317:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.972343:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2b7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab314 expref: 58 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.972361:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab314 expref: 57 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947588.972370:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:2.0:1783947588.972387:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947588.972391:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631a00, rc 0) 00000100:00100000:2.0:1783947588.973002:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+57:11591:x1870604297921792:12345-192.168.203.32@tcp:101:bash.0 Request processed in 897us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947588.973011:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 209 00000100:00100000:3.0:1783947588.981288:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947588.982678:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297922048 00000100:00100000:0.0:1783947588.982690:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297922048 00000100:00100000:0.0:1783947588.982764:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:2.0:1783947588.982769:0:5800:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1783947588.982774:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+57:11591:x1870604297922048:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:2.0:1783947588.982777:0:5800:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1783947588.983621:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+58:11591:x1870604297922048:12345-192.168.203.32@tcp:35:bash.0 Request processed in 778us (2272us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1783947588.983630:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:1.0:1783947589.080313:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947589.080397:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297922176 00000100:00100000:3.0:1783947589.080406:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297922176 00000100:00100000:3.0:1783947589.080529:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 210 00000100:00100000:3.0:1783947589.080540:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+58:11597:x1870604297922176:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1783947589.080564:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947589.080585:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2b8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab31b expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.080672:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb2b94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.080687:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb2b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.080698:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb2b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947589.080753:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1783947589.080757:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947589.080774:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb2b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.080807:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2b8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab31b expref: 60 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.080822:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb2b94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab31b expref: 59 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.080829:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:3.0:1783947589.080831:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947589.080834:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c8147d000, rc 0) 00000100:00100000:3.0:1783947589.080879:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+59:11597:x1870604297922176:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 341us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947589.080886:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 210 00000100:00080000:1.0:1783947589.081210:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947589.085762:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947589.086957:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297922304 00000100:00100000:0.0:1783947589.086969:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297922304 00000100:00100000:0.0:1783947589.087112:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 211 00000100:00100000:0.0:1783947589.087124:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+59:11597:x1870604297922304:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1783947589.087152:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947589.087174:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb2b9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab322 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087254:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2ba2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087268:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087399:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087439:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2ba9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087458:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087466:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087673:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2bb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087682:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087689:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947589.087722:0:6613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783947589.087727:0:6613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783947589.087745:0:6613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087769:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087777:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087783:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2ba2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087790:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087869:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670e00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947589.087873:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087881:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2ba2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087892:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:0.0:1783947589.087895:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947589.087899:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2ba2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087905:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2ba2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087919:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087925:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087937:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087942:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947589.087945:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087951:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087959:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b3c8281b900) 00010000:00010000:0.0:1783947589.087962:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947589.087965:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2ba9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.087971:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2ba9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.088014:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670800/0x20c3e53e78bb2b9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab322 expref: 61 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.088028:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab322 expref: 60 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.088035:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:0.0:1783947589.088037:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947589.088039:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670400, rc 0) 00000100:00100000:0.0:1783947589.088107:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+60:11597:x1870604297922304:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 986us (2353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947589.088123:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 211 00000100:00100000:3.0:1783947589.092720:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947589.092768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947589.093007:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297922688 00000100:00100000:2.0:1783947589.093016:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297922688 00000100:00100000:2.0:1783947589.093069:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:2.0:1783947589.093078:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+60:2356:x1870604297922688:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947589.093094:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947589.093117:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670400/0x20c3e53e78bb2bb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab322 expref: 60 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.093143:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:2.0:1783947589.093146:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947589.093188:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+59:2356:x1870604297922688:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 111us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947589.093194:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:1.0:1783947589.093755:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297922560 00000100:00100000:1.0:1783947589.093761:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297922560 00000100:00100000:1.0:1783947589.093804:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 212 00000100:00100000:1.0:1783947589.093811:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+59:11597:x1870604297922560:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1783947589.093825:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947589.093839:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824800/0x20c3e53e78bb2bb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab329 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.093929:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824c00/0x20c3e53e78bb2bbe lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.093944:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab314 expref: 60 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.093961:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824c00/0x20c3e53e78bb2bbe lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.093999:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab314 expref: 60 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.094011:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab314 expref: 60 pid: 5797 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947589.094024:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5795:1870604319928960:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947589.094084:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb61a7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783947589.099127:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947589.099692:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297922816 00000100:00100000:0.0:1783947589.099702:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297922816 00010000:00010000:0.0:1783947589.099743:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b86 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab314 expref: 61 pid: 5797 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947589.099775:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 77 00000100:00100000:0.0:1783947589.099784:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+61:2354:x1870604297922816:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947589.099807:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947589.099815:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b86 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab314 expref: 61 pid: 5797 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.099827:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab314 expref: 61 pid: 5797 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.099849:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:0.0:1783947589.099854:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824c00/0x20c3e53e78bb2bbe lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.099863:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824c00/0x20c3e53e78bb2bbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.099870:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824c00/0x20c3e53e78bb2bbe lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.099887:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947589.099946:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+61:2354:x1870604297922816:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 163us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947589.099982:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 77 00010000:00010000:3.0:1783947589.100864:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631a00/0x20c3e53e78bb2b86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab314 expref: 60 pid: 5797 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947589.100881:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5795:1870604319928960:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947589.100901:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824c00/0x20c3e53e78bb2bbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.100909:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824c00/0x20c3e53e78bb2bbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.100915:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824c00/0x20c3e53e78bb2bbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947589.100933:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783947589.101073:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824800/0x20c3e53e78bb2bb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab329 expref: 61 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.101087:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824c00/0x20c3e53e78bb2bbe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab329 expref: 60 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.101094:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:3.0:1783947589.101097:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783947589.101099:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cbd824c00, rc 0) 00000100:00100000:3.0:1783947589.101153:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+60:11597:x1870604297922560:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 7343us (8444us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1783947589.101160:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 212 00000100:00100000:1.0:1783947589.105476:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947589.105687:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297923072 00000100:00100000:2.0:1783947589.105698:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297923072 00000100:00100000:2.0:1783947589.105759:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:2.0:1783947589.105769:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+60:11597:x1870604297923072:12345-192.168.203.32@tcp:103:lfs.0 00010000:00010000:2.0:1783947589.105783:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947589.105807:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2b1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2ff expref: 60 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.105842:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:2.0:1783947589.105847:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947589.105905:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+59:11597:x1870604297923072:12345-192.168.203.32@tcp:103:lfs.0 Request processed in 137us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947589.105912:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:2.0:1783947589.110017:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947589.110106:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297923200 00000100:00100000:0.0:1783947589.110117:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297923200 00000100:00100000:0.0:1783947589.110174:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 213 00000100:00100000:0.0:1783947589.110183:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+59:11597:x1870604297923200:12345-192.168.203.32@tcp:58:lfs.0 00010000:00010000:0.0:1783947589.110288:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2bcc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.110305:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2bcc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.110316:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2bcc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783947589.111183:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1783947589.111284:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+59:11597:x1870604297923200:12345-192.168.203.32@tcp:58:lfs.0 Request processed in 1092us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947589.111293:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 213 00000100:00100000:1.0:1783947589.114960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947589.115065:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297923328 00000100:00100000:0.0:1783947589.115077:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297923328 00000100:00100000:0.0:1783947589.115224:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 214 00000100:00100000:0.0:1783947589.115235:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+59:11597:x1870604297923328:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1783947589.115255:0:6613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947589.115276:0:6613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2bd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab330 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.115337:0:6613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2bcc lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.115347:0:6613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2bd3 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab330 expref: 60 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.115381:0:6613:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2bcc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.115394:0:6613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2bd3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab330 expref: 60 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.115408:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:0.0:1783947589.115411:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947589.115415:0:6613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2bd3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab330 expref: 60 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.115470:0:6613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670e00, rc 0) 00000100:00100000:0.0:1783947589.115529:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+60:11597:x1870604297923328:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 296us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947589.115537:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 214 00000040:00080000:2.0:1783947589.500451:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947589.500460:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947589.500524:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1783947589.500531:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783947589.501042:0:11551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b856ec380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870604319929088:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783947589.501205:0:11551:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e423c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947589.507943:0:11551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b856ec380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870604319929088:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783947589.509149:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947589.509236:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297923456 00000100:00100000:1.0:1783947589.509244:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297923456 00000100:00100000:1.0:1783947589.509307:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 215 00000100:00100000:1.0:1783947589.509325:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+60:11598:x1870604297923456:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783947589.509354:0:5798:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783947589.509472:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+60:11598:x1870604297923456:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 156us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947589.511798:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 215 00000100:00100000:2.0:1783947589.522066:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947589.522726:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297923584 00000100:00100000:3.0:1783947589.522737:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297923584 00000100:00100000:3.0:1783947589.522825:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 216 00000100:00100000:3.0:1783947589.522835:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+60:11598:x1870604297923584:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783947589.522905:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2bda lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.522923:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2bda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.522935:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2bda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.522965:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb2be1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.522979:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb2be1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.522986:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb2be1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523010:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2be8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523018:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2be8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523024:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2be8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947589.523062:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783947589.523066:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947589.523079:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2be8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523097:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2bda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523103:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2bda lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523110:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2bda lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523115:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147d600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947589.523119:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2bda lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523370:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2bda lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523384:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b3c84bc6300) 00010000:00010000:3.0:1783947589.523387:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947589.523392:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2bda lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523398:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d600/0x20c3e53e78bb2bda lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523455:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb2be1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523462:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb2be1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523467:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb2be1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523480:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147ca00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947589.523893:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb2be1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523902:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb2be1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523918:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8b3c84af9800) 00010000:00010000:3.0:1783947589.523921:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947589.523924:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb2be1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523929:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb2be1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523948:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2be8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523954:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2be8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523959:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2be8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523965:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1ba00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947589.523967:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2be8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.523984:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2be8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.524006:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:3.0:1783947589.524008:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947589.524011:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2be8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.524397:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2be8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947589.524672:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+60:11598:x1870604297923584:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 Request processed in 1833us (2610us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947589.524683:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 216 00000100:00100000:3.0:1783947589.536266:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947589.536382:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297923840 00000100:00100000:1.0:1783947589.536392:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297923840 00000100:00100000:1.0:1783947589.536495:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 217 00000100:00100000:1.0:1783947589.536506:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+60:11598:x1870604297923840:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947589.536527:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947589.536548:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824600/0x20c3e53e78bb2bef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab337 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.536644:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824400/0x20c3e53e78bb2bf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.536661:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824400/0x20c3e53e78bb2bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.536672:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824400/0x20c3e53e78bb2bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947589.536684:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1783947589.536796:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824400/0x20c3e53e78bb2bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.536805:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824400/0x20c3e53e78bb2bf6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.536812:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824400/0x20c3e53e78bb2bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.536818:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd824400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947589.536822:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824400/0x20c3e53e78bb2bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.536842:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824400/0x20c3e53e78bb2bf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.536854:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:1.0:1783947589.536857:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783947589.536862:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824400/0x20c3e53e78bb2bf6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.536868:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824400/0x20c3e53e78bb2bf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.536911:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824600/0x20c3e53e78bb2bef lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab337 expref: 62 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.536922:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b3c84bc6300) 00010000:00010000:1.0:1783947589.536924:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947589.536928:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824600/0x20c3e53e78bb2bef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab337 expref: 62 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.536937:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cbd824600, rc 0) 00000100:00100000:1.0:1783947589.537014:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+61:11598:x1870604297923840:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 509us (756us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1783947589.537022:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 217 00000100:00100000:0.0:1783947589.542938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947589.543038:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297923968 00000100:00100000:3.0:1783947589.543048:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297923968 00000100:00100000:3.0:1783947589.543106:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 218 00000100:00100000:3.0:1783947589.543115:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+61:11598:x1870604297923968:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783947589.543187:0:6613:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783947589.543525:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+61:11598:x1870604297923968:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 410us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947589.543533:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 218 00000100:00100000:3.0:1783947589.552936:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947589.554153:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297924224 00000100:00100000:1.0:1783947589.554168:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297924224 00000100:00100000:1.0:1783947589.554236:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 219 00000100:00100000:1.0:1783947589.554246:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+61:11598:x1870604297924224:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947589.554290:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947589.554294:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783947589.554322:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147d000/0x20c3e53e78bb2b94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab31b expref: 61 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.554341:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:1.0:1783947589.554346:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947589.554360:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824600/0x20c3e53e78bb2c04 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab33e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783947589.556938:0:5798:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1783947589.557721:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824400/0x20c3e53e78bb2c0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.557739:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824400/0x20c3e53e78bb2c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.557762:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824400/0x20c3e53e78bb2c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.557840:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824600/0x20c3e53e78bb2c04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab33e expref: 63 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.557859:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824400/0x20c3e53e78bb2c0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab33e expref: 62 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.557868:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b3c82977d00) 00010000:00010000:1.0:1783947589.557871:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947589.557888:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cbd824400, rc 0) 00000100:00100000:1.0:1783947589.560912:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+62:11598:x1870604297924224:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 6654us (7971us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1783947589.560926:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 219 00000100:00100000:0.0:1783947589.564717:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947589.564926:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297924480 00000100:00100000:3.0:1783947589.564935:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297924480 00000100:00100000:3.0:1783947589.571553:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 220 00000100:00100000:3.0:1783947589.571580:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+62:11598:x1870604297924480:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783947589.571643:0:6613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947589.571685:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824400/0x20c3e53e78bb2c0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab33e expref: 62 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.571706:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b3c82977d00) 00010000:00010000:3.0:1783947589.571719:0:6613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947589.571741:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2c19 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.571767:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2c19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.571778:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2c19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.572054:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x11e7dba6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.572065:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x11e7dba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.572073:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x11e7dba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.572164:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2c19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.572172:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2c19 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.572179:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2c19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.572185:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1ba00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947589.572199:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2c19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.572207:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2c19 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.572216:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:3.0:1783947589.572219:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947589.572223:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2c19 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.572229:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2c19 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.572241:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x11e7dba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.572371:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x11e7dba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.572378:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x11e7dba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.572383:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947589.572386:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x11e7dba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.572391:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x11e7dba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.572399:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x11e7dba6 (ffff8b3c84af9800) 00010000:00010000:3.0:1783947589.572401:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947589.572410:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x11e7dba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.572441:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x11e7dba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947589.572600:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+61:11598:x1870604297924480:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 1032us (7889us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783947589.572609:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 220 00000100:00100000:0.0:1783947589.583189:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947589.583454:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297924608 00000100:00100000:2.0:1783947589.583465:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297924608 00000100:00100000:2.0:1783947589.583518:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 221 00000100:00100000:2.0:1783947589.583528:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+61:11598:x1870604297924608:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947589.583551:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947589.583576:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb2c27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab345 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.583613:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2c2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.583645:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2c2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.583656:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2c2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.583758:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb2c27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab345 expref: 63 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.583776:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2c2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab345 expref: 62 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.583786:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b3c84bc6500) 00010000:00010000:2.0:1783947589.583789:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783947589.583792:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631800, rc 0) 00000100:00100000:2.0:1783947589.583848:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+62:11598:x1870604297924608:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 322us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947589.583856:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 221 00000100:00100000:2.0:1783947589.603613:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947589.603724:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297924864 00000100:00100000:3.0:1783947589.603732:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297924864 00000100:00100000:3.0:1783947589.603796:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 222 00000100:00100000:3.0:1783947589.603806:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+62:11598:x1870604297924864:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783947589.603884:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.603901:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.603912:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783947589.604486:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1783947589.604497:0:6613:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 404875078521ns, next at 405875075866ns, rc = 0 00000004:00010000:3.0:1783947589.604583:0:6613:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ee83f41e reply state 0000000092ff980a transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947589.604593:0:6613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783947589.604686:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+64:11598:x1870604297924864:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 880us (1079us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1783947589.604709:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 222 00010000:00010000:2.0:1783947589.607896:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.607913:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.607921:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.607927:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947589.607944:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.607952:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.607989:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b3c84bc6500) 00010000:00010000:2.0:1783947589.607992:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783947589.607997:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.608003:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb2c35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947589.608324:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947589.609025:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297924992 00000100:00100000:1.0:1783947589.609038:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297924992 00000100:00100000:1.0:1783947589.609123:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 223 00000100:00100000:1.0:1783947589.609147:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+63:11598:x1870604297924992:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947589.609171:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947589.609190:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824600/0x20c3e53e78bb2c3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab34c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.609256:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824600/0x20c3e53e78bb2c3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab34c expref: 64 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.609271:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824600/0x20c3e53e78bb2c3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab34c expref: 64 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.609290:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b3c84bc6500) 00010000:00010000:1.0:1783947589.609292:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783947589.609295:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cbd824600, rc 0) 00000100:00100000:1.0:1783947589.609362:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+64:11598:x1870604297924992:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 223us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947589.609369:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 223 00000100:00100000:0.0:1783947589.614647:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947589.614854:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297925120 00000100:00100000:2.0:1783947589.614863:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297925120 00000100:00100000:2.0:1783947589.614925:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:2.0:1783947589.614935:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2356:x1870604297925120:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783947589.616610:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2356:x1870604297925120:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 1666us (1962us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1783947589.616624:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00080000:1.0:1783947589.617007:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947589.630630:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947589.630804:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297925376 00000100:00100000:0.0:1783947589.630813:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297925376 00000100:00100000:0.0:1783947589.630902:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:0.0:1783947589.630912:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+64:11598:x1870604297925376:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783947589.631611:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+65:11598:x1870604297925376:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 697us (988us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1783947589.631637:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:0.0:1783947589.638667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947589.641654:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297925632 00000100:00100000:1.0:1783947589.641671:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297925632 00000100:00100000:1.0:1783947589.641843:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 224 00000100:00100000:1.0:1783947589.641869:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+65:11598:x1870604297925632:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783947589.642013:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+65:11598:x1870604297925632:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 145us (3355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947589.642020:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 224 00000100:00100000:2.0:1783947589.648189:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947589.648341:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297925760 00000100:00100000:1.0:1783947589.648351:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297925760 00000100:00100000:1.0:1783947589.648470:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 225 00000100:00100000:1.0:1783947589.648480:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+65:11598:x1870604297925760:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947589.648503:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947589.648525:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824400/0x20c3e53e78bb2c43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab353 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.648603:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825c00/0x20c3e53e78bb2c4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.648617:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825c00/0x20c3e53e78bb2c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.648628:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825c00/0x20c3e53e78bb2c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947589.648663:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783947589.648681:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825c00/0x20c3e53e78bb2c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.648706:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824400/0x20c3e53e78bb2c43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab353 expref: 67 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.648724:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825c00/0x20c3e53e78bb2c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab353 expref: 66 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.648748:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b3c84bc6500) 00010000:00010000:1.0:1783947589.648751:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783947589.648754:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cbd825c00, rc 0) 00000100:00100000:1.0:1783947589.648803:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+66:11598:x1870604297925760:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 325us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947589.648810:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 225 00000100:00100000:0.0:1783947589.652926:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947589.653154:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297925888 00000100:00100000:3.0:1783947589.653164:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297925888 00000100:00100000:3.0:1783947589.653224:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00100000:3.0:1783947589.653234:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2354:x1870604297925888:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947589.653262:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947589.653292:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038345f41/0x20c3e53e78bb2c51 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab35a expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947589.653318:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54e144, blocks: 0x1 00010000:00010000:3.0:1783947589.653338:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1783947589.653343:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947589.653353:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038345f41/0x20c3e53e78bb2c51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab35a expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.653371:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000038345f41/0x20c3e53e78bb2c51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab35a expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.653384:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1ba00, rc 0) 00000100:00100000:3.0:1783947589.653473:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2354:x1870604297925888:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 239us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947589.653480:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00100000:0.0:1783947589.671771:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947589.671915:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297926144 00000100:00100000:3.0:1783947589.671924:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297926144 00000100:00100000:3.0:1783947589.672015:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 226 00000100:00100000:3.0:1783947589.672026:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+66:11598:x1870604297926144:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783947589.672145:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+66:11598:x1870604297926144:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 120us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947589.672152:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 226 00000100:00100000:2.0:1783947589.680544:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947589.680657:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297926272 00000100:00100000:0.0:1783947589.680668:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297926272 00000100:00100000:0.0:1783947589.680722:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:0.0:1783947589.680731:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:11598:x1870604297926272:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947589.680748:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947589.680766:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb2c58 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab361 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.680796:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038345f41/0x20c3e53e78bb2c51 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab35a expref: 10 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.680805:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947589.680809:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947589.680815:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb2c58 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab361 expref: 10 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.680847:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038345f41/0x20c3e53e78bb2c51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab35a expref: 10 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.680860:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038345f41/0x20c3e53e78bb2c51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab35a expref: 10 pid: 6590 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947589.680893:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1870604319929216:192.168.203.32@tcp:104: 00000100:00100000:0.0:1783947589.681055:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87ec6300 going to sleep for 11 seconds 00000100:00100000:3.0:1783947589.689683:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319929344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947589.689775:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783947589.690024:0:6748:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 404960604534ns, next at 405960602425ns, rc = 0 00000100:00100000:0.0:1783947589.690068:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b856ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870604319929600:0@lo:400:kworker.0 00000100:00100000:0.0:1783947589.690103:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947589.690349:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947589.690358:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b856ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319929472:0@lo:400:kworker.0 00000100:00100000:0.0:1783947589.690391:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947589.690463:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b856ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319929728:0@lo:400:kworker.0 00000100:00100000:0.0:1783947589.690488:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947589.692006:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319929600 00000100:00100000:0.0:1783947589.692019:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319929600 00000100:00100000:0.0:1783947589.692072:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319929728 00000100:00100000:0.0:1783947589.692075:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319929728 00000100:00100000:3.0:1783947589.696392:0:11568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319929344 00000100:00100000:3.0:1783947589.696404:0:11568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319929344 00000100:00100000:2.0:1783947589.696457:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319929472 00000100:00100000:2.0:1783947589.696564:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319929472 00000100:00100000:2.0:1783947589.696632:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1783947589.696645:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319929472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947589.696737:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319929472:12345-0@lo:400:kworker.0 Request processed in 97us (6344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947589.696757:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1783947589.696805:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319929984:0@lo:400:kworker.0 00000100:00100000:2.0:1783947589.696838:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947589.697726:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783947589.697739:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb660b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319929856:0@lo:400:kworker.0 00000100:00100000:0.0:1783947589.698249:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783947589.698260:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870604319929600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947589.698392:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870604319929600:12345-0@lo:400:kworker.0 Request processed in 134us (8288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947589.698399:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783947589.698414:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783947589.698438:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319929728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947589.698470:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319929728:12345-0@lo:400:kworker.0 Request processed in 35us (7981us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947589.698476:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783947589.698599:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947589.698642:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b856ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319929728:0@lo:400:kworker.0 00000100:00100000:2.0:1783947589.698678:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b856ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319929472:0@lo:400:kworker.0 00000100:00100000:2.0:1783947589.698690:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b856ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870604319929600:0@lo:400:kworker.0 00000100:00100000:2.0:1783947589.698712:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319929984 00000100:00100000:2.0:1783947589.698717:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319929984 00000100:00100000:1.0:1783947589.700180:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319929856 00000100:00100000:1.0:1783947589.700192:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319929856 00000100:00100000:1.0:1783947589.700240:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1783947589.700247:0:11568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783947589.700253:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319929856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947589.700262:0:11568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1870604319929344:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947589.700333:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319929856:12345-0@lo:400:kworker.0 Request processed in 84us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947589.700340:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00002000:00000024:3.0:1783947589.700357:0:11568:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783947589.700384:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb660b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319929856:0@lo:400:kworker.0 00000100:00100000:3.0:1783947589.700403:0:11568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1870604319929344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (10626us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947589.700411:0:11568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783947589.700469:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319929344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947589.703500:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1870604319929216:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947589.703541:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb2c58 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab361 expref: 10 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.703566:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671800, rc 0) 00000100:00100000:3.0:1783947589.703635:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+10:11598:x1870604297926272:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 22904us (23101us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947589.703646:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:1.0:1783947589.708698:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947589.710368:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297926400 00000100:00100000:3.0:1783947589.710399:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297926400 00010000:00010000:3.0:1783947589.710486:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038345f41/0x20c3e53e78bb2c51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab35a expref: 10 pid: 6590 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947589.710533:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 78 00000100:00100000:3.0:1783947589.710543:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+10:2354:x1870604297926400:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947589.710557:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947589.710589:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038345f41/0x20c3e53e78bb2c51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab35a expref: 10 pid: 6590 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.710607:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038345f41/0x20c3e53e78bb2c51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab35a expref: 10 pid: 6590 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.710631:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038345f41/0x20c3e53e78bb2c51 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab35a expref: 10 pid: 6590 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.710648:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947589.710652:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947589.710661:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb2c58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab361 expref: 9 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.710672:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb2c58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab361 expref: 9 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783947589.710881:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783947589.710936:0:5784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb2c58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab361 expref: 9 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947589.710964:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85bc6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5784:1870604319930112:192.168.203.32@tcp:105: 00000100:00080000:1.0:1783947589.711054:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947589.711060:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947589.711063:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87ec6000 going to sleep for 11 seconds 00000100:00100000:2.0:1783947589.711520:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783947589.711532:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319929984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947589.711608:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319929984:12345-0@lo:400:kworker.0 Request processed in 78us (14768us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947589.711615:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783947589.711651:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:2.0:1783947589.711657:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:2.0:1783947589.711678:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319929984:0@lo:400:kworker.0 00000100:00100000:0.0:1783947589.717355:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85bc6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5784:1870604319930112:192.168.203.32@tcp:105: 00010000:00010000:0.0:1783947589.717380:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947589.717458:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2354:x1870604297926400:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 6916us (8768us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947589.717469:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 78 00000100:00100000:3.0:1783947589.717990:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947589.718516:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297926528 00000100:00100000:0.0:1783947589.718524:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297926528 00002000:00100000:0.0:1783947589.718583:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8b3c879e8700 x1870604297926528/t0(0) o4->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:380/0 lens 504/0 e 0 to 0 dl 1783947600 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783947589.718594:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3c879e8700 with x1870604297926528 ext(0->12) 00002000:00010000:0.0:1783947589.718600:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b3c879e8700 00000100:00100000:0.0:1783947589.718638:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:0.0:1783947589.718647:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2354:x1870604297926528:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783947589.719242:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+11:2354:x1870604297926528:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 Request processed in 469us (1127us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1783947589.719257:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00002000:00100000:0.0:1783947589.719265:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8b3c879e8700 x1870604297926528/t4294967321(0) o4->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:380/0 lens 504/448 e 0 to 0 dl 1783947600 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783947589.719283:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3c879e8700 with x1870604297926528 ext(0->12) 00002000:00010000:0.0:1783947589.719293:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b3c879e8700 00000100:00100000:3.0:1783947589.726091:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947589.726311:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297926656 00000100:00100000:1.0:1783947589.726320:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297926656 00000100:00100000:1.0:1783947589.726372:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 227 00000100:00100000:1.0:1783947589.726381:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+66:11598:x1870604297926656:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 00000004:00080000:3.0:1783947589.820593:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:3.0:1783947589.820616:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:3.0:1783947589.820638:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:3.0:1783947589.820663:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:3.0:1783947589.820711:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1783947589.820724:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b3c811cad80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1783947589.820735:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b3cb6bb7600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b3c811ca480 00000020:00080000:3.0:1783947589.820739:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b3cb6bb7b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b3cb6709800 00000004:00080000:3.0:1783947589.820771:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1783947589.820784:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b3cb66f26c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1783947589.820787:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b3c8663fa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b3cb66f23c0 00000020:00080000:3.0:1783947589.820791:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b3c8663fc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b3b84a83c00 00000020:00080000:3.0:1783947589.820919:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1783947589.821111:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1783947589.822375:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c879e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319930240:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783947589.822460:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947589.822538:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319930240 00000100:00100000:3.0:1783947589.822545:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319930240 00000100:00100000:3.0:1783947589.822591:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783947589.822600:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1870604319930240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783947589.822629:0:8151:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1783947589.822659:0:8151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a54e143, atime: 0x6a54e143, ctime: 0x6a54e143, blocks: 0x1 00010000:00010000:3.0:1783947589.822667:0:8151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038345f41/0x20c3e53e78bb2c5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.822683:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=405s v=(0 0) 00010000:00010000:3.0:1783947589.822700:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947589.822708:0:8151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038345f41/0x20c3e53e78bb2c5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.822724:0:8151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038345f41/0x20c3e53e78bb2c5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.822735:0:8151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038345f41/0x20c3e53e78bb2c5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.822743:0:8151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038345f41/0x20c3e53e78bb2c5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.822761:0:8151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783947589.823249:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c879e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319930368:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783947589.823293:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947589.823325:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947589.823338:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c879ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319930496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783947589.823362:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947589.823391:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319930368 00000100:00100000:1.0:1783947589.823396:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319930368 00000100:00100000:1.0:1783947589.823440:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319930496 00000100:00100000:1.0:1783947589.823444:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319930496 00000100:00100000:1.0:1783947589.823460:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783947589.823467:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1870604319930368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783947589.823485:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1783947589.823500:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c08b452/0x20c3e53e78bb2c66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.823516:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2a21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2c0 expref: 10 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.823523:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1783947589.823526:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783947589.823530:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c08b452/0x20c3e53e78bb2c66 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.823559:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2a21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2c0 expref: 10 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.823572:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2a21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2c0 expref: 10 pid: 8151 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947589.823584:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1870604319930624:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947589.823645:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cbd501480 going to sleep for 11 seconds 00000100:00100000:3.0:1783947589.824748:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1870604319930240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2142us (2281us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1783947589.824759:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783947589.824785:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783947589.824794:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1870604319930496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1783947589.824918:0:8151:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783947589.824921:0:8151:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1783947589 00002000:00010000:3.0:1783947589.824923:0:8151:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783947589.824926:0:8151:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1783947588 -> 1783947589 00002000:00010000:3.0:1783947589.824928:0:8151:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783947589.824977:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1870604319930496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 177us (1606us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1783947589.824983:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:3.0:1783947589.825018:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947589.825025:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038345f41/0x20c3e53e78bb2c5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.825034:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1ba00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947589.825038:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038345f41/0x20c3e53e78bb2c5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.825048:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038345f41/0x20c3e53e78bb2c5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.825067:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038345f41/0x20c3e53e78bb2c5f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.825075:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038345f41/0x20c3e53e78bb2c5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.825093:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947589.825096:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947589.825097:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947589.827685:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947589.827717:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297926784 00000100:00100000:3.0:1783947589.827726:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297926784 00010000:00010000:3.0:1783947589.827762:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2a21 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2c0 expref: 11 pid: 8151 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947589.827840:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 79 00000100:00100000:3.0:1783947589.827851:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+11:2354:x1870604297926784:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947589.827879:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947589.827886:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2a21 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2c0 expref: 11 pid: 8151 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.827901:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2a21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2c0 expref: 11 pid: 8151 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.827926:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783947589.827931:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783947589.827936:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000c08b452/0x20c3e53e78bb2c66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.827946:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c08b452/0x20c3e53e78bb2c66 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.827967:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947589.830007:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+20:11598:x1870604297926656:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 Request processed in 103616us (103916us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947589.830021:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 227 00000004:00080000:1.0:1783947589.831101:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b3c879ea300/2, rc 0, transno 4294967322 00000100:00100000:1.0:1783947589.831113:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c879ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319930496:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1783947589.831204:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa799d68/0x20c3e53e78bb2a21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2c0 expref: 11 pid: 8151 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947589.831223:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1870604319930624:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947589.831247:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000c08b452/0x20c3e53e78bb2c66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.831259:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000c08b452/0x20c3e53e78bb2c66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.831266:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c08b452/0x20c3e53e78bb2c66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.831277:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c08b452/0x20c3e53e78bb2c66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.831285:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c08b452/0x20c3e53e78bb2c66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.831317:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783947589.831909:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1870604319930368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8440us (8612us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1783947589.831927:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1783947589.831983:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b3c879e9f80/2, rc 0, transno 4294967323 00000100:00100000:1.0:1783947589.831988:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c879e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319930368:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783947589.832868:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947589.832880:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c08b452/0x20c3e53e78bb2c66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.832901:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd825a00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:2.0:1783947589.832905:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c08b452/0x20c3e53e78bb2c66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.832915:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c08b452/0x20c3e53e78bb2c66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.832935:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c08b452/0x20c3e53e78bb2c66 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.832943:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c08b452/0x20c3e53e78bb2c66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.832965:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947589.832967:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947589.832978:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947589.833094:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+10:2354:x1870604297926784:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 5242us (5413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947589.833106:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 79 00000004:00080000:0.0:1783947589.833548:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b3c879e9180/2, rc 0, transno 4294967310 00000100:00100000:0.0:1783947589.833557:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c879e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319930240:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783947589.840507:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947589.840595:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297926912 00000100:00100000:0.0:1783947589.840605:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297926912 00000100:00100000:0.0:1783947589.840666:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:0.0:1783947589.840677:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+10:2353:x1870604297926912:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1783947589.896118:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1783947589.896152:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000100:00100000:0.0:1783947589.896561:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2353:x1870604297926912:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 Request processed in 55879us (56056us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947589.896574:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:3.0:1783947589.909169:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947589.909582:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297927168 00000100:00100000:1.0:1783947589.909593:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297927168 00000100:00100000:1.0:1783947589.909693:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 228 00000100:00100000:1.0:1783947589.909704:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+20:11598:x1870604297927168:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783947589.909758:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947589.909785:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825c00/0x20c3e53e78bb2c4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab353 expref: 20 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.909815:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b3c84bc6500) 00010000:00010000:1.0:1783947589.909828:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947589.909861:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c6d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.909876:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.909885:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947589.910141:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000015ae26a3 reply state 00000000574ce01f transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947589.910151:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783947589.910265:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:11598:x1870604297927168:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 562us (1104us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1783947589.910289:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 228 00010000:00010000:1.0:1783947589.914049:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.914069:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.914077:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.914083:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd825400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947589.914088:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.914096:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c6d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.914116:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b3c84bc6500) 00010000:00010000:1.0:1783947589.914120:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947589.914125:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c6d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.914131:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947589.915966:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947589.916139:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297927296 00000100:00100000:0.0:1783947589.916150:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297927296 00000100:00100000:0.0:1783947589.916316:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 70 00000100:00100000:0.0:1783947589.916326:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2353:x1870604297927296:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783947589.916626:0:6591:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1783947589.916630:0:6591:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1783947589 -> 1783947588 00002000:00010000:0.0:1783947589.916633:0:6591:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1783947587 00002000:00010000:0.0:1783947589.916635:0:6591:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1783947589 -> 1783947588 00002000:00010000:0.0:1783947589.916637:0:6591:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1783947589.916690:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2353:x1870604297927296:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 365us (731us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1783947589.916698:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 70 00000100:00100000:3.0:1783947589.938057:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947589.941196:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297927552 00000100:00100000:0.0:1783947589.941211:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297927552 00000100:00100000:1.0:1783947589.944873:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 229 00000100:00100000:1.0:1783947589.944888:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+20:11598:x1870604297927552:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783947589.944958:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.945001:0:6613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2c2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab345 expref: 20 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.945011:0:6613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c74 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.945046:0:6613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2c2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab345 expref: 20 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.945060:0:6613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2c2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab345 expref: 20 pid: 5797 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947589.945075:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6613:1870604319930752:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947589.945177:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cbd501480 going to sleep for 11 seconds 00010000:00010000:0.0:1783947589.946543:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947589.954826:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6613:1870604319930752:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947589.954855:0:6613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947589.958562:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947589.958717:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297927680 00000100:00100000:1.0:1783947589.958727:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297927680 00010000:00010000:1.0:1783947589.958770:0:8318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2c2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab345 expref: 21 pid: 5797 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947589.958811:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 80 00000100:00100000:1.0:1783947589.958820:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6700e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:2354:x1870604297927680:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947589.958838:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947589.958861:0:8318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2c2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab345 expref: 21 pid: 5797 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.958876:0:8318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2c2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab345 expref: 21 pid: 5797 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.958902:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631800/0x20c3e53e78bb2c2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab345 expref: 21 pid: 5797 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.958922:0:8318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b3c84bc6500) 00010000:00010000:1.0:1783947589.958928:0:8318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.958939:0:8318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.958948:0:8318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c74 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.958984:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947589.959047:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6700e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+20:2354:x1870604297927680:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 227us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947589.959055:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 80 00010000:00010000:3.0:1783947589.959226:0:6613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.959245:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.959275:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.959282:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.959288:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.959294:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd825400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947589.959298:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.959306:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.959315:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b3c84bc6500) 00010000:00010000:3.0:1783947589.959319:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1783947589.959322:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.959329:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2c74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947589.959368:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:11598:x1870604297927552:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 Request processed in 14483us (21321us total) trans 0 rc -22/-22 00000100:00100000:3.0:1783947589.959376:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 229 00000100:00100000:2.0:1783947589.961815:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947589.961898:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297927808 00000100:00100000:3.0:1783947589.961908:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297927808 00000100:00100000:3.0:1783947589.961977:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 71 00000100:00100000:3.0:1783947589.961988:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cc03ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2353:x1870604297927808:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783947589.962033:0:8151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb2c7b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.962063:0:8151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb2c58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab361 expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.962073:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1783947589.962078:0:8151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783947589.962083:0:8151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb2c7b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.962118:0:8151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb2c58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab361 expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.962142:0:8151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb2c58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab361 expref: 8 pid: 6591 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947589.962157:0:8151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6703480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8151:1870604319930880:192.168.203.32@tcp:104: 00000100:00100000:3.0:1783947589.962235:0:8151:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8820c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947589.967689:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947589.967765:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297927936 00000100:00100000:0.0:1783947589.967789:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297927936 00010000:00010000:0.0:1783947589.967827:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb2c58 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab361 expref: 9 pid: 6591 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947589.967877:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 81 00000100:00100000:0.0:1783947589.967888:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2354:x1870604297927936:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947589.967903:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947589.967926:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb2c58 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab361 expref: 9 pid: 6591 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.967938:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb2c58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab361 expref: 9 pid: 6591 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.967962:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783947589.967976:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783947589.967982:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb2c7b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.967991:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb2c7b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.968011:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947589.968070:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+9:2354:x1870604297927936:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 183us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947589.968079:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 81 00010000:00010000:3.0:1783947589.968191:0:8151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb2c58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab361 expref: 8 pid: 6591 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947589.968210:0:8151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6703480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8151:1870604319930880:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947589.968239:0:8151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb2c7b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.968249:0:8151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb2c7b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.968261:0:8151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb2c7b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.970017:0:8151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb2c7b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.970036:0:8151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb2c7b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.970054:0:8151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb2c7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.970063:0:8151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a000 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947589.970069:0:8151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb2c7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.970078:0:8151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb2c7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.970100:0:8151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb2c7b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947589.970127:0:8151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cbbb987/0x20c3e53e78bb2c7b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947589.970223:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cc03ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2353:x1870604297927808:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 Request processed in 8234us (8415us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947589.970232:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 71 00000100:00100000:2.0:1783947589.974336:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947589.974444:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297928192 00000100:00100000:0.0:1783947589.974454:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297928192 00000100:00100000:0.0:1783947589.974519:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 230 00000100:00100000:0.0:1783947589.974530:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:11598:x1870604297928192:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783947589.974606:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.974624:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.974636:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.974836:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2c89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.974848:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824600/0x20c3e53e78bb2c3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab34c expref: 20 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.974857:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2c89 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.974888:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824600/0x20c3e53e78bb2c3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab34c expref: 20 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947589.974902:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824600/0x20c3e53e78bb2c3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab34c expref: 20 pid: 5798 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947589.974916:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85bc6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1870604319931008:192.168.203.32@tcp:104: 00000100:00100000:0.0:1783947589.975006:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87ec6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947589.979270:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947589.979455:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85bc6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1870604319931008:192.168.203.32@tcp:104: 00010000:00010000:0.0:1783947589.979507:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2c89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947589.985334:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297928320 00000100:00100000:1.0:1783947589.985348:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297928320 00010000:00010000:1.0:1783947589.985408:0:8318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824600/0x20c3e53e78bb2c3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab34c expref: 21 pid: 5798 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947589.985462:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 82 00000100:00100000:1.0:1783947589.985471:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:2354:x1870604297928320:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947589.985502:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947589.985510:0:8318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824600/0x20c3e53e78bb2c3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab34c expref: 21 pid: 5798 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.985523:0:8318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824600/0x20c3e53e78bb2c3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab34c expref: 21 pid: 5798 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.985545:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824600/0x20c3e53e78bb2c3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab34c expref: 21 pid: 5798 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.985561:0:8318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b3c84bc6500) 00010000:00010000:1.0:1783947589.985567:0:8318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2c89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.985576:0:8318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2c89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.985583:0:8318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2c89 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947589.985628:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947589.985696:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+20:2354:x1870604297928320:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 225us (6435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947589.985705:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 82 00010000:00010000:2.0:1783947589.986090:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2c89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.986100:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2c89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783947589.986303:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1783947589.986497:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1783947589.986542:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1783947589.986625:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1870604319931136:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783947589.986681:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947589.986713:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e42000 going to sleep for 11 seconds 00000100:00100000:1.0:1783947589.986998:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319931136 00000100:00100000:1.0:1783947589.987006:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319931136 00000100:00100000:1.0:1783947589.987044:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783947589.987053:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5798:x1870604319931136:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783947589.987150:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5798:x1870604319931136:12345-0@lo:1000:mdt00_002.0 Request processed in 98us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947589.987163:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783947589.987997:0:5798:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:2.0:1783947589.988005:0:5798:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b3c879ea300, transno 4294967322 00000004:00080000:2.0:1783947589.988020:0:5798:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b3c879e9f80, transno 4294967323 00000100:00100000:2.0:1783947589.988028:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1870604319931136:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1783947589.989265:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1783947589.989342:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1870604319931264:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783947589.989403:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947589.989455:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e42480 going to sleep for 11 seconds 00000100:00100000:1.0:1783947589.989554:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319931264 00000100:00100000:1.0:1783947589.989562:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319931264 00000100:00100000:1.0:1783947589.989613:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783947589.989622:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5798:x1870604319931264:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783947589.989832:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5798:x1870604319931264:12345-0@lo:1000:mdt00_002.0 Request processed in 211us (428us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1783947589.989840:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783947589.990248:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1870604319931264:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1783947589.990283:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2c89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.990293:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2c89 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.990301:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2c89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.990307:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671e00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947589.990312:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2c89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.990319:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2c89 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.990346:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b3c84bc6500) 00010000:00010000:2.0:1783947589.990349:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947589.990354:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2c89 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.990361:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb2c89 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.990390:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2bcc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.990397:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2bcc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.990403:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2bcc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.990408:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947589.990411:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2bcc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.990450:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2bcc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.990459:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:2.0:1783947589.990462:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947589.990468:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2bd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab330 expref: 23 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.990480:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2bd3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab330 expref: 23 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.990496:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2bd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab330 expref: 23 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947589.990525:0:5798:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2bd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab330 expref: 23 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947589.990538:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b856ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1870604319931392:192.168.203.32@tcp:105: 00000100:00100000:2.0:1783947589.990608:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e42480 going to sleep for 11 seconds 00000100:00100000:2.0:1783947590.001539:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947590.002813:0:12341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297928448 00000100:00100000:1.0:1783947590.002826:0:12341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297928448 00000100:00100000:1.0:1783947590.002894:0:12341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:1.0:1783947590.002904:0:12341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:11597:x1870604297928448:12345-192.168.203.32@tcp:49:lfs.0 00000100:00100000:1.0:1783947590.003059:0:12341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+24:11597:x1870604297928448:12345-192.168.203.32@tcp:49:lfs.0 Request processed in 155us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947590.003067:0:12341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:0.0:1783947590.005331:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b856ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1870604319931392:192.168.203.32@tcp:105: 00010000:00010000:0.0:1783947590.005362:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2bcc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.005373:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670200/0x20c3e53e78bb2bcc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.005412:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2c90 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.005506:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2c90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.005519:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2c90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.005530:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2c90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.005537:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2c90 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.005544:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2c90 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.005550:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947590.005555:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2c90 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.005579:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2c90 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.005591:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:0.0:1783947590.005594:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947590.005597:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2c90 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.005604:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671400/0x20c3e53e78bb2c90 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.005615:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.005622:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.005628:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.005634:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947590.005637:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.005643:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.005649:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:0.0:1783947590.005651:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783947590.005654:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.005669:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947590.005955:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:11598:x1870604297928192:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 31424us (31626us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1783947590.005975:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 230 00000020:00080000:0.0:1783947590.005982:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783947590.009529:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947590.009540:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947590.010024:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1783947590.010033:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783947590.018370:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947590.018537:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297928704 00000100:00100000:1.0:1783947590.018547:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297928704 00000100:00100000:1.0:1783947590.018604:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 231 00000100:00100000:1.0:1783947590.018614:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:11597:x1870604297928704:12345-192.168.203.32@tcp:58:lfs.0 00000040:00080000:1.0:1783947590.018988:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1783947590.019075:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:11597:x1870604297928704:12345-192.168.203.32@tcp:58:lfs.0 Request processed in 461us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947590.019083:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 231 00000100:00100000:0.0:1783947590.032244:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947590.032460:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297928960 00000100:00100000:1.0:1783947590.032472:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297928960 00000100:00100000:1.0:1783947590.032531:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:1.0:1783947590.032556:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85719850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+23:11598:x1870604297928960:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783947590.033266:0:5799:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783947590.039038:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1783947590.039121:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.039138:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.039150:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.039158:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c97 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.039165:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c97 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.039170:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947590.039195:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783947590.039245:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947590.039254:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.039263:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671800 already unused, calling callback (ffffffffc1552360) 00010000:00010000:2.0:1783947590.039267:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.039275:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.039287:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b3c8281b900) 00010000:00010000:2.0:1783947590.039290:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783947590.039319:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c97 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.039326:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671800/0x20c3e53e78bb2c97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.039346:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947590.039347:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947590.039349:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947590.039891:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85719850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+25:11598:x1870604297928960:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 7331us (7649us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1783947590.039913:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 62 00000020:00080000:0.0:1783947590.039920:0:5799:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783947590.079862:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947590.080089:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297929088 00000100:00100000:1.0:1783947590.080166:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297929088 00000100:00100000:1.0:1783947590.080232:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 232 00000100:00100000:1.0:1783947590.080243:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+25:11600:x1870604297929088:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1783947590.080699:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947590.080722:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824600/0x20c3e53e78bb2c9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab368 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947590.080784:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824a00/0x20c3e53e78bb2ca5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947590.080798:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824a00/0x20c3e53e78bb2ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947590.080808:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824a00/0x20c3e53e78bb2ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947590.080824:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825200/0x20c3e53e78bb2cac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947590.080830:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825200/0x20c3e53e78bb2cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947590.080837:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825200/0x20c3e53e78bb2cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947590.081155:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2cb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947590.081180:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824c00/0x20c3e53e78bb2bbe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab329 expref: 26 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947590.081188:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2cb3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947590.081221:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824c00/0x20c3e53e78bb2bbe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab329 expref: 26 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947590.081236:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824c00/0x20c3e53e78bb2bbe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab329 expref: 26 pid: 5795 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947590.081251:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1870604319931520:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947590.081362:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cbd501240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947590.088379:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947590.088846:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297929344 00000100:00100000:3.0:1783947590.088857:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297929344 00000100:00100000:3.0:1783947590.088921:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:3.0:1783947590.088931:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+27:5571:x1870604297929344:12345-192.168.203.32@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783947590.090380:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1870604319931520:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947590.090408:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2cb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947590.091169:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+28:5571:x1870604297929344:12345-192.168.203.32@tcp:35:ldlm_bl.0 Request processed in 2236us (2796us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1783947590.091180:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:0.0:1783947590.096366:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947590.096691:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297929472 00000100:00100000:3.0:1783947590.096724:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297929472 00010000:00010000:3.0:1783947590.096766:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824c00/0x20c3e53e78bb2bbe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab329 expref: 28 pid: 5795 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947590.096817:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 83 00000100:00100000:3.0:1783947590.096826:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+28:2353:x1870604297929472:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947590.096842:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947590.096849:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824c00/0x20c3e53e78bb2bbe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab329 expref: 28 pid: 5795 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947590.096893:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824c00/0x20c3e53e78bb2bbe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab329 expref: 28 pid: 5795 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947590.096915:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824c00/0x20c3e53e78bb2bbe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab329 expref: 28 pid: 5795 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947590.096932:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:3.0:1783947590.096937:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2cb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947590.096947:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947590.096955:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2cb3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947590.096999:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947590.097052:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+27:2353:x1870604297929472:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 226us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947590.097060:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 83 00010000:00010000:2.0:1783947590.097291:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.097299:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947590.097340:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783947590.097345:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783947590.097364:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.097377:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.097388:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824a00/0x20c3e53e78bb2ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.097396:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824a00/0x20c3e53e78bb2ca5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.097443:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824a00/0x20c3e53e78bb2ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.097682:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd824a00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947590.097688:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824a00/0x20c3e53e78bb2ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.097697:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824a00/0x20c3e53e78bb2ca5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.097707:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:2.0:1783947590.097710:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947590.097714:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824a00/0x20c3e53e78bb2ca5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.097721:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824a00/0x20c3e53e78bb2ca5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.097734:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825200/0x20c3e53e78bb2cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.097741:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825200/0x20c3e53e78bb2cac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.097748:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825200/0x20c3e53e78bb2cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.097753:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd825200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947590.097756:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825200/0x20c3e53e78bb2cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.097762:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825200/0x20c3e53e78bb2cac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.097781:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b3c82977c00) 00010000:00010000:2.0:1783947590.097784:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947590.097787:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825200/0x20c3e53e78bb2cac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.097793:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825200/0x20c3e53e78bb2cac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.097841:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824600/0x20c3e53e78bb2c9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab368 expref: 27 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.097855:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab368 expref: 26 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947590.097862:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:2.0:1783947590.097864:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947590.097866:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cbd825800, rc 0) 00000100:00100000:2.0:1783947590.097900:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+26:11600:x1870604297929088:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 17659us (18048us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947590.097908:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 232 00000100:00100000:3.0:1783947590.204033:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b856eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319931648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947590.204115:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947590.205089:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319931648 00000100:00100000:1.0:1783947590.205101:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319931648 00000100:00100000:1.0:1783947590.205157:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783947590.205167:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1870604319931648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947590.205191:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1783947590.205268:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1870604319931648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947590.205284:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783947590.205586:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b856eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319931648:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1783947590.935903:0:12380:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783947590.935913:0:12380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783947590.936046:0:12380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1783947590.936053:0:12380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783947590.972216:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783947591.033628:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947591.033638:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947591.033677:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783947591.033683:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783947591.033808:0:11551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b856eca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870604319931776:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783947591.033909:0:11551:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e66540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947591.038163:0:11551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b856eca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870604319931776:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783947591.048714:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947591.049950:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297929600 00000100:00100000:1.0:1783947591.049972:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297929600 00000100:00100000:1.0:1783947591.050059:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 233 00000100:00100000:1.0:1783947591.050070:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+26:11612:x1870604297929600:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783947591.050115:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783947591.050237:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+26:11612:x1870604297929600:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 169us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947591.050246:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 233 00000100:00080000:2.0:1783947591.050341:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947591.056116:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947591.058575:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297929856 00000100:00100000:3.0:1783947591.058590:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297929856 00000100:00100000:3.0:1783947591.058660:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 234 00000100:00100000:3.0:1783947591.058670:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+26:11612:x1870604297929856:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947591.058706:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947591.058726:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2cba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab36f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947591.058824:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2cc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947591.058839:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947591.058851:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947591.058863:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783947591.059031:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2cba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab36f expref: 29 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947591.059052:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab36f expref: 28 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947591.059062:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:3.0:1783947591.059065:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947591.059069:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a000, rc 0) 00000100:00100000:3.0:1783947591.059143:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+28:11612:x1870604297929856:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 473us (3042us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1783947591.059150:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 234 00000100:00100000:3.0:1783947591.065790:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947591.066871:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947591.067064:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297930112 00000100:00100000:1.0:1783947591.067073:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297930112 00000100:00100000:1.0:1783947591.067124:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 235 00000100:00100000:1.0:1783947591.067134:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+28:11612:x1870604297930112:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783947591.067211:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2ccf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947591.067228:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2ccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947591.067239:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2ccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947591.067412:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2ccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947591.067463:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2ccf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947591.067470:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2ccf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947591.067475:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd824200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947591.067478:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2ccf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947591.067486:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2ccf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947591.067497:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:1.0:1783947591.067500:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783947591.067505:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2ccf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947591.067511:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824200/0x20c3e53e78bb2ccf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947591.067529:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297930240 00000100:00100000:3.0:1783947591.067535:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297930240 00000100:00100000:3.0:1783947591.067583:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:3.0:1783947591.067592:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+30:2355:x1870604297930240:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947591.067602:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947591.067618:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a000/0x20c3e53e78bb2cc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab36f expref: 30 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947591.067632:0:8318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:3.0:1783947591.067637:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947591.067664:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+29:11612:x1870604297930112:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 529us (1881us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1783947591.067665:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+29:2355:x1870604297930240:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 73us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947591.067681:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:1.0:1783947591.067682:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 235 00000040:00080000:1.0:1783947591.067793:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783947591.067798:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783947591.068286:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1783947591.068295:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783947591.075810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947591.075992:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297930496 00000100:00100000:3.0:1783947591.076003:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297930496 00000100:00100000:3.0:1783947591.076063:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00100000:3.0:1783947591.076074:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+28:11612:x1870604297930496:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783947591.077449:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+29:11612:x1870604297930496:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 1368us (1640us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1783947591.077711:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 64 00010000:00010000:2.0:1783947591.993552:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783947592.775932:0:12431:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947592.775941:0:12431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947592.776009:0:12431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783947592.776015:0:12431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783947593.015716:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947593.021485:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297930752 00000100:00100000:2.0:1783947593.021499:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297930752 00000100:00100000:2.0:1783947593.021691:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 236 00000100:00100000:2.0:1783947593.021704:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+29:11633:x1870604297930752:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1783947593.021727:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947593.021870:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630800/0x20c3e53e78bb2cd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab376 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947593.022114:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2cdd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947593.022130:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2cdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947593.022141:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2cdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947593.022152:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783947593.022705:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630800/0x20c3e53e78bb2cd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab376 expref: 32 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947593.022723:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2cdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab376 expref: 31 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947593.022732:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947593.022867:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:2.0:1783947593.022871:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783947593.022874:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631e00, rc 0) 00000100:00100000:2.0:1783947593.022938:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+31:11633:x1870604297930752:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1237us (7232us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1783947593.022956:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 236 00000100:00080000:2.0:1783947593.023447:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947593.031694:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947593.032679:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297930880 00000100:00100000:1.0:1783947593.032697:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297930880 00000100:00100000:1.0:1783947593.032758:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 237 00000100:00100000:1.0:1783947593.032772:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+31:11633:x1870604297930880:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:1.0:1783947593.032843:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824e00/0x20c3e53e78bb2ceb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947593.032862:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824e00/0x20c3e53e78bb2ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947593.032874:0:6613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824e00/0x20c3e53e78bb2ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947593.032902:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824e00/0x20c3e53e78bb2ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947593.032908:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824e00/0x20c3e53e78bb2ceb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947593.032915:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824e00/0x20c3e53e78bb2ceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947593.032921:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd824e00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947593.032925:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824e00/0x20c3e53e78bb2ceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947593.032933:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824e00/0x20c3e53e78bb2ceb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947593.032944:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:1.0:1783947593.032960:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947593.032965:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824e00/0x20c3e53e78bb2ceb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947593.032981:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd824e00/0x20c3e53e78bb2ceb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947593.033048:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+31:11633:x1870604297930880:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 279us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947593.033055:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 237 00000100:00100000:0.0:1783947593.157060:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947593.157206:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297931008 00000100:00100000:1.0:1783947593.157216:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297931008 00000100:00080000:2.0:1783947593.157289:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947593.157296:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 72 00000100:00100000:1.0:1783947593.157308:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2354:x1870604297931008:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:1.0:1783947593.157327:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947593.157350:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079c72bfc/0x20c3e53e78bb2cf2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab37d expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783947593.157376:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a54e144, atime: 0x6a54e143, ctime: 0x6a54e144, blocks: 0xb 00010000:00010000:1.0:1783947593.157396:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=408s v=(0 0) 00010000:00010000:1.0:1783947593.157401:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947593.157411:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079c72bfc/0x20c3e53e78bb2cf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab37d expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947593.157473:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000079c72bfc/0x20c3e53e78bb2cf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab37d expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947593.157488:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cbd824e00, rc 0) 00000100:00100000:1.0:1783947593.157540:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2354:x1870604297931008:12345-192.168.203.32@tcp:101:cat.0 Request processed in 235us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947593.157563:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 72 00000100:00100000:0.0:1783947593.161578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947593.161684:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297931136 00000100:00100000:2.0:1783947593.161695:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297931136 00002000:00100000:2.0:1783947593.161744:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8b3b85bc7480 x1870604297931136/t0(0) o3->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:384/0 lens 488/0 e 0 to 0 dl 1783947604 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783947593.161755:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3b85bc7480 with x1870604297931136 ext(0->4095) 00002000:00010000:2.0:1783947593.161760:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b3b85bc7480 00000100:00100000:2.0:1783947593.161803:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:2.0:1783947593.161813:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2353:x1870604297931136:12345-192.168.203.32@tcp:3:cat.0 00000100:00100000:2.0:1783947593.162027:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+8:2353:x1870604297931136:12345-192.168.203.32@tcp:3:cat.0 Request processed in 215us (458us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1783947593.162036:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00002000:00100000:2.0:1783947593.162044:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8b3b85bc7480 x1870604297931136/t0(0) o3->d1ed966c-3190-4795-821d-ae5dca7b5f51@192.168.203.32@tcp:384/0 lens 488/4536 e 0 to 0 dl 1783947604 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783947593.162052:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b3b85bc7480 with x1870604297931136 ext(0->4095) 00002000:00010000:2.0:1783947593.162056:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b3b85bc7480 00000001:00080000:2.0:1783947593.353929:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1783947593.353960:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1783947593.353972:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:2.0:1783947593.480492:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947593.480537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947593.480566:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947593.480687:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297931520 00000100:00100000:1.0:1783947593.480697:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297931520 00000100:00100000:1.0:1783947593.480771:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 170 00000100:00100000:1.0:1783947593.480780:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2356:x1870604297931520:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947593.480851:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:2356:x1870604297931520:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 73us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947593.480858:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 170 00000100:00080000:2.0:1783947593.481167:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947593.481224:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297931392 00000100:00100000:0.0:1783947593.481229:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297931392 00000100:00100000:3.0:1783947593.481270:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297931264 00000100:00100000:3.0:1783947593.481277:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297931264 00000100:00100000:0.0:1783947593.481286:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 77 00000100:00100000:0.0:1783947593.481298:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85da8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2356:x1870604297931392:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947593.481314:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 301 00000100:00100000:3.0:1783947593.481324:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:2356:x1870604297931264:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947593.481344:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85da8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2356:x1870604297931392:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 49us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947593.481352:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 77 00000100:00100000:3.0:1783947593.481361:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+13:2356:x1870604297931264:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 38us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947593.481369:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 301 00000100:00080000:2.0:1783947593.481612:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783947594.044208:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947594.810206:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319931904:0@lo:400:kworker.0 00000100:00100000:2.0:1783947594.810295:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd49d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319932288:0@lo:400:kworker.0 00000100:00100000:2.0:1783947594.810344:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947594.810459:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1870604319932160:0@lo:400:kworker.0 00000100:00100000:2.0:1783947594.810486:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947594.810504:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783947594.810510:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319932032:0@lo:400:kworker.0 00000100:00100000:2.0:1783947594.810528:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947594.810542:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd49f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319932544:0@lo:400:kworker.0 00000100:00100000:3.0:1783947594.812199:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319932288 00000100:00100000:1.0:1783947594.812199:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947594.812217:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319932288 00000100:00100000:1.0:1783947594.812239:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85bc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319932672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947594.812293:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783947594.812305:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319932288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947594.812337:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947594.812405:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319932288:12345-0@lo:400:kworker.0 Request processed in 101us (2058us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947594.812414:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783947594.812468:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319932160 00000100:00100000:3.0:1783947594.812493:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1783947594.812501:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1783947594.812524:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b3c879e9180, transno 4294967310 00000100:00100000:3.0:1783947594.812539:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd49d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319932288:0@lo:400:kworker.0 00000100:00080000:2.0:1783947594.812737:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947594.812764:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947594.813167:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319932416:0@lo:400:kworker.0 00000100:00100000:2.0:1783947594.813203:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947594.813239:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319931904 00000100:00100000:2.0:1783947594.813244:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319931904 00000100:00100000:2.0:1783947594.814195:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1783947594.814208:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319931904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947594.814266:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319931904:12345-0@lo:400:kworker.0 Request processed in 62us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947594.814283:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1783947594.814438:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319932160 00000100:00100000:2.0:1783947594.814534:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319931904:0@lo:400:kworker.0 00000100:00100000:1.0:1783947594.814537:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319932032 00000100:00100000:1.0:1783947594.814547:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319932032 00000100:00100000:1.0:1783947594.814570:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319932416 00000100:00100000:1.0:1783947594.814574:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319932416 00000100:00100000:1.0:1783947594.814609:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783947594.814621:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870604319932160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947594.814707:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870604319932160:12345-0@lo:400:kworker.0 Request processed in 88us (4219us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947594.814716:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783947594.814737:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783947594.814746:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319932032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947594.815002:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319932032:12345-0@lo:400:kworker.0 Request processed in 258us (4473us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947594.815027:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783947594.815042:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1783947594.815049:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319932416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947594.815098:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319932416:12345-0@lo:400:kworker.0 Request processed in 50us (1893us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947594.815105:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1783947594.815143:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319932672 00000100:00100000:1.0:1783947594.815148:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319932672 00000100:00100000:1.0:1783947594.815318:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783947594.815330:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319932672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783947594.815374:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783947594.815481:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319932672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (3147us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947594.815488:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1783947594.815517:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947594.815576:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319932416:0@lo:400:kworker.0 00000100:00100000:2.0:1783947594.816221:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947594.817035:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85bc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319932672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947594.820835:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319932544 00000100:00100000:3.0:1783947594.820850:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319932544 00000100:00100000:3.0:1783947594.820944:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783947594.820954:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1870604319932544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947594.821037:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1870604319932544:12345-0@lo:400:kworker.0 Request processed in 86us (4823us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947594.821044:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783947594.821235:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1870604319932160:0@lo:400:kworker.0 00000100:00100000:2.0:1783947594.821271:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319932032:0@lo:400:kworker.0 00000100:00100000:2.0:1783947594.821282:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd49f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319932544:0@lo:400:kworker.0 00000100:00080000:1.0:1783947594.821506:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1783947594.877765:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000001:00080000:3.0:1783947594.877781:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:3.0:1783947594.877796:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1783947594.877805:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b3c87e42000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1783947594.877809:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b3cb6bb7900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b3c87e42cc0 00000020:00080000:3.0:1783947594.877812:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b3cb6bb7200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b3cb671d000 00000020:00080000:3.0:1783947594.877846:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1783947594.877988:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1783947594.878253:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1783947595.066098:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783947595.196034:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783947595.196043:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783947595.196096:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1783947595.196104:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783947595.327511:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947595.327558:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb655fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319932800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947595.327667:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947595.330830:0:11568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319932800 00000100:00100000:2.0:1783947595.330853:0:11568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319932800 00000100:00100000:2.0:1783947595.330927:0:11568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783947595.330953:0:11568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1870604319932800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783947595.331007:0:11568:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947595.331119:0:11568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1870604319932800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (3451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947595.331127:0:11568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783947595.339042:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb655fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319932800:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1783947595.403625:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1783947595.403647:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00010000:00010000:0.0:1783947596.089911:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947597.114641:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947597.998756:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947597.998973:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297931648 00000100:00100000:1.0:1783947597.998988:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297931648 00000100:00100000:1.0:1783947597.999090:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 238 00000100:00100000:1.0:1783947597.999104:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:11286:x1870604297931648:12345-192.168.203.32@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1783947597.999256:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:11286:x1870604297931648:12345-192.168.203.32@tcp:60:lhsmtool_posix.0 Request processed in 156us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947597.999264:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 238 00000100:00080000:2.0:1783947597.999740:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947598.007612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947598.007968:0:12341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297931904 00000100:00100000:2.0:1783947598.007983:0:12341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297931904 00000100:00100000:2.0:1783947598.008063:0:12341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:2.0:1783947598.008076:0:12341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:11286:x1870604297931904:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783947598.008834:0:12341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:11286:x1870604297931904:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 754us (1232us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1783947598.008855:0:12341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 65 00010000:00010000:0.0:1783947598.141055:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947598.239717:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947598.239871:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297932032 00000100:00100000:1.0:1783947598.239885:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297932032 00000100:00100000:1.0:1783947598.239994:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 239 00000100:00100000:1.0:1783947598.240007:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+5:12085:x1870604297932032:12345-192.168.203.32@tcp:101:lsof.0 00010000:00010000:1.0:1783947598.240035:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947598.240063:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2cf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab384 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947598.240150:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825c00/0x20c3e53e78bb2d00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947598.240170:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825c00/0x20c3e53e78bb2d00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947598.240196:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825c00/0x20c3e53e78bb2d00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947598.240596:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783947598.240602:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1783947598.240694:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825c00/0x20c3e53e78bb2d00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947598.240726:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825400/0x20c3e53e78bb2cf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab384 expref: 7 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947598.240756:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825c00/0x20c3e53e78bb2d00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab384 expref: 6 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947598.240767:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c82977500) 00010000:00010000:1.0:1783947598.240771:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947598.240775:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cbd825c00, rc 0) 00000100:00100000:1.0:1783947598.240860:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+6:12085:x1870604297932032:12345-192.168.203.32@tcp:101:lsof.0 Request processed in 856us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947598.240869:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 239 00000100:00080000:2.0:1783947598.241060:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947598.605072:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947598.605136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947598.605195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947598.605475:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297932288 00000100:00100000:1.0:1783947598.605489:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297932288 00000100:00100000:1.0:1783947598.605575:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297932416 00000100:00100000:1.0:1783947598.605579:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297932416 00000100:00100000:1.0:1783947598.605611:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 80 00000100:00100000:1.0:1783947598.605624:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b86507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2355:x1870604297932288:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947598.605730:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b86507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2355:x1870604297932288:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 107us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947598.605739:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 80 00000100:00100000:1.0:1783947598.605902:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 81 00000100:00100000:1.0:1783947598.605921:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2355:x1870604297932416:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947598.605954:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2355:x1870604297932416:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 46us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947598.605961:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 81 00000100:00100000:2.0:1783947598.606189:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297932160 00000100:00100000:2.0:1783947598.606195:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297932160 00000100:00100000:2.0:1783947598.606236:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 303 00000100:00100000:2.0:1783947598.606250:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:2355:x1870604297932160:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947598.606280:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64dfe14-87c9-4273-a23c-517e593e369d+13:2355:x1870604297932160:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 31us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947598.606286:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 303 00000100:00080000:0.0:1783947598.609255:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783947598.609269:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783947599.162125:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947599.930352:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb65dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319932928:0@lo:400:kworker.0 00000100:00100000:1.0:1783947599.930410:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319933312:0@lo:400:kworker.0 00000100:00100000:2.0:1783947599.930489:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947599.930551:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319932928 00000100:00100000:0.0:1783947599.930574:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319932928 00000100:00100000:3.0:1783947599.930578:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb65de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319933056:0@lo:400:kworker.0 00000100:00100000:0.0:1783947599.930639:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1783947599.930650:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319932928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947599.930698:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947599.930725:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3314:x1870604319932928:12345-0@lo:400:kworker.0 Request processed in 76us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947599.930734:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1783947599.930797:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319933312 00000100:00100000:0.0:1783947599.930802:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319933312 00000100:00100000:1.0:1783947599.930822:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd85f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1870604319933184:0@lo:400:kworker.0 00000100:00100000:0.0:1783947599.930850:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783947599.930858:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319933312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947599.930865:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947599.930928:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319933312:12345-0@lo:400:kworker.0 Request processed in 70us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947599.930936:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783947599.930949:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319933312:0@lo:400:kworker.0 00000100:00080000:0.0:1783947599.930959:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947599.931031:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319933696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947599.931061:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947599.931063:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319933184 00000100:00100000:1.0:1783947599.931069:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319933184 00000100:00100000:0.0:1783947599.931116:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319933696 00000100:00100000:0.0:1783947599.931121:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319933696 00000100:00100000:1.0:1783947599.931131:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1783947599.931141:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870604319933184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947599.931154:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783947599.931164:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319933696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947599.931200:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783947599.931207:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870604319933184:12345-0@lo:400:kworker.0 Request processed in 68us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947599.931216:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783947599.931241:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319933696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (178us total) trans 0 rc 0/0 00000100:00080000:1.0:1783947599.931242:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947599.931252:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783947599.931274:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319933696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947599.931288:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd85f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1870604319933184:0@lo:400:kworker.0 00000100:00100000:2.0:1783947599.935229:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb65dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319932928:0@lo:400:kworker.0 00000100:00100000:2.0:1783947599.935252:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319933440:0@lo:400:kworker.0 00000100:00100000:2.0:1783947599.935327:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947599.936063:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319933440 00000100:00100000:2.0:1783947599.936073:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319933440 00000100:00100000:2.0:1783947599.936857:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783947599.936872:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb655fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319933440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947599.936978:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb655fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319933440:12345-0@lo:400:kworker.0 Request processed in 111us (1651us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947599.936986:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:2.0:1783947599.937018:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947599.937053:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319933440:0@lo:400:kworker.0 00000100:00100000:3.0:1783947599.942072:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947599.942135:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319933056 00000100:00100000:3.0:1783947599.942148:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319933056 00000100:00100000:3.0:1783947599.942220:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783947599.942232:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319933056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947599.942314:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319933056:12345-0@lo:400:kworker.0 Request processed in 85us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947599.942324:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783947599.942388:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb65de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319933056:0@lo:400:kworker.0 00000100:00100000:3.0:1783947599.942404:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319933568:0@lo:400:kworker.0 00000100:00100000:3.0:1783947599.942458:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947599.942486:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319933568 00000100:00100000:3.0:1783947599.942490:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319933568 00000100:00100000:3.0:1783947599.942535:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783947599.942543:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319933568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947599.942576:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319933568:12345-0@lo:400:kworker.0 Request processed in 34us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947599.942584:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1783947599.942741:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947599.943672:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1783947599.943783:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1783947599.943814:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319933568:0@lo:400:kworker.0 00000020:00080000:3.0:1783947600.011100:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1783947600.011158:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1783947600.011323:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1783947600.011360:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1783947600.185742:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947600.442286:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947600.442337:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319933824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947600.442474:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947600.442788:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319933824 00000100:00100000:0.0:1783947600.442802:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319933824 00000100:00100000:0.0:1783947600.442891:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783947600.442912:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd49d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319933824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783947600.443079:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947600.446514:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd49d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319933824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3588us (4022us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947600.446535:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783947600.449665:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319933824:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783947601.209955:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783947601.785063:0:12634:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:59:59 (1783947599) 00010000:00010000:2.0:1783947602.234563:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947603.257571:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947603.733759:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947603.733804:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947603.733837:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947603.733861:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947603.733916:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297932800 00000100:00100000:3.0:1783947603.733917:0:8151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297932928 00000100:00100000:0.0:1783947603.733927:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297932800 00000100:00100000:3.0:1783947603.733936:0:8151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297932928 00000100:00100000:0.0:1783947603.733999:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00100000:0.0:1783947603.734015:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2356:x1870604297932800:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947603.734103:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2356:x1870604297932800:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 82us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947603.734365:0:8151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 85 00000100:00100000:3.0:1783947603.734396:0:8151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2356:x1870604297932928:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947603.734495:0:8151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2356:x1870604297932928:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 117us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947603.735641:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00080000:0.0:1783947603.735687:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783947603.735693:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947603.735764:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947603.735933:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297932672 00000100:00100000:2.0:1783947603.735946:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297932672 00000100:00100000:0.0:1783947603.736009:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297932544 00000100:00100000:0.0:1783947603.736020:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297932544 00000100:00100000:2.0:1783947603.736039:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297933056 00000100:00100000:2.0:1783947603.736046:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297933056 00000100:00100000:0.0:1783947603.736072:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 305 00000100:00100000:0.0:1783947603.736086:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+13:2356:x1870604297932544:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947603.736094:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 177 00000100:00100000:2.0:1783947603.736107:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:2356:x1870604297932672:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947603.736207:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:2356:x1870604297932672:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 100us (2456us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947603.736218:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 177 00000100:00100000:0.0:1783947603.736240:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64dfe14-87c9-4273-a23c-517e593e369d+13:2356:x1870604297932544:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 154us (2397us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947603.736250:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 178 00000100:00100000:0.0:1783947603.736262:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 305 00000100:00100000:2.0:1783947603.736271:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+6:2356:x1870604297933056:12345-192.168.203.32@tcp:400:kworker.0 00000100:00080000:0.0:1783947603.736311:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947603.736321:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+6:2356:x1870604297933056:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 55us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947603.736331:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 178 00000100:00100000:3.0:1783947603.743934:0:8151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 85 00010000:00010000:2.0:1783947604.281956:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947605.050045:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319933952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947605.050114:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947605.050181:0:11568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319933952 00000100:00100000:2.0:1783947605.050188:0:11568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319933952 00000100:00100000:1.0:1783947605.050373:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b856ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319934208:0@lo:400:kworker.0 00000100:00100000:1.0:1783947605.050404:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783947605.050460:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947605.050479:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319934208 00000100:00100000:1.0:1783947605.050483:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319934208 00000100:00100000:1.0:1783947605.050520:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783947605.050529:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319934208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947605.050580:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319934208:12345-0@lo:400:kworker.0 Request processed in 52us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947605.050599:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783947605.050636:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319934080:0@lo:400:kworker.0 00000100:00100000:1.0:1783947605.050681:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947605.050702:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319934080 00000100:00100000:1.0:1783947605.050705:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319934080 00000100:00100000:0.0:1783947605.050774:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c879ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319934464:0@lo:400:kworker.0 00000100:00100000:0.0:1783947605.050802:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947605.051294:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b856ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319934208:0@lo:400:kworker.0 00000100:00100000:2.0:1783947605.054203:0:11568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783947605.054232:0:11568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319933952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947605.054272:0:11568:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783947605.054363:0:11568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319933952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (4248us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947605.054370:0:11568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783947605.054414:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c879e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319934336:0@lo:400:kworker.0 00000100:00100000:2.0:1783947605.054469:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947605.057480:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1783947605.057503:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3311:x1870604319934080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947605.057585:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3311:x1870604319934080:12345-0@lo:400:kworker.0 Request processed in 94us (6903us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947605.057592:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1783947605.057634:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319934464 00000100:00100000:1.0:1783947605.057641:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319934464 00000100:00100000:1.0:1783947605.057692:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319934336 00000100:00100000:1.0:1783947605.057696:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319934336 00000100:00100000:1.0:1783947605.057715:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783947605.057721:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319934464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947605.057757:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319934464:12345-0@lo:400:kworker.0 Request processed in 36us (6954us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947605.057764:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783947605.057968:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1783947605.057975:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319934336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947605.058008:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319934336:12345-0@lo:400:kworker.0 Request processed in 34us (3539us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947605.058014:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:1.0:1783947605.058037:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947605.062369:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319934080:0@lo:400:kworker.0 00000100:00100000:0.0:1783947605.062387:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c879e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319934592:0@lo:400:kworker.0 00000100:00100000:0.0:1783947605.062469:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947605.062610:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319934592 00000100:00100000:2.0:1783947605.062618:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319934592 00000100:00100000:2.0:1783947605.062687:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783947605.062697:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319934592:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783947605.062704:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947605.062751:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319934592:12345-0@lo:400:kworker.0 Request processed in 55us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947605.062758:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783947605.063149:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c879ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319934464:0@lo:400:kworker.0 00000100:00100000:3.0:1783947605.063172:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319933952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947605.064013:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c879e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319934336:0@lo:400:kworker.0 00000100:00100000:0.0:1783947605.068633:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c879e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319934592:0@lo:400:kworker.0 00010000:00010000:1.0:1783947605.305695:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947605.433649:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947605.433754:0:12341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297933312 00000100:00100000:1.0:1783947605.433768:0:12341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297933312 00000100:00100000:1.0:1783947605.433869:0:12341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 66 00000100:00100000:1.0:1783947605.433883:0:12341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+18:12306:x1870604297933312:12345-192.168.203.32@tcp:35:umount.0 00000100:00100000:1.0:1783947605.434697:0:12341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:12306:x1870604297933312:12345-192.168.203.32@tcp:35:umount.0 Request processed in 813us (1064us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1783947605.434709:0:12341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 66 00000040:00080000:2.0:1783947605.435439:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947605.435448:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00080000:3.0:1783947605.435695:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1783947605.436031:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1783947605.436040:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783947605.444558:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947605.444657:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297933568 00000100:00100000:3.0:1783947605.444672:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297933568 00000100:00100000:3.0:1783947605.444749:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 67 00000100:00100000:3.0:1783947605.444761:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+19:12306:x1870604297933568:12345-192.168.203.32@tcp:35:umount.0 00000100:00100000:3.0:1783947605.445247:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1ed966c-3190-4795-821d-ae5dca7b5f51+20:12306:x1870604297933568:12345-192.168.203.32@tcp:35:umount.0 Request processed in 486us (703us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1783947605.445256:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 67 00000100:00100000:0.0:1783947605.448266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947605.448406:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297933824 00000100:00100000:3.0:1783947605.448458:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297933824 00000100:00100000:3.0:1783947605.448535:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:3.0:1783947605.448547:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c8571b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+20:12306:x1870604297933824:12345-192.168.203.32@tcp:35:umount.0 00000100:00100000:3.0:1783947605.450177:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c8571b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:12306:x1870604297933824:12345-192.168.203.32@tcp:35:umount.0 Request processed in 1611us (1903us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1783947605.450193:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:0.0:1783947605.453264:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947605.453472:0:12341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297934080 00000100:00100000:1.0:1783947605.453485:0:12341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297934080 00000100:00100000:1.0:1783947605.453560:0:12341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:1.0:1783947605.453571:0:12341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:12306:x1870604297934080:12345-192.168.203.32@tcp:35:umount.0 00000100:00100000:1.0:1783947605.454554:0:12341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+22:12306:x1870604297934080:12345-192.168.203.32@tcp:35:umount.0 Request processed in 979us (1300us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1783947605.454567:0:12341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:0.0:1783947605.460848:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947605.460903:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947605.460932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947605.461113:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297934336 00000100:00100000:2.0:1783947605.461128:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297934336 00000100:00100000:2.0:1783947605.461210:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297934208 00000100:00100000:2.0:1783947605.461214:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297934208 00000100:00100000:2.0:1783947605.461227:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297934464 00000100:00100000:2.0:1783947605.461230:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297934464 00000100:00100000:2.0:1783947605.461245:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:2.0:1783947605.461255:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87f1f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d64dfe14-87c9-4273-a23c-517e593e369d+15:2353:x1870604297934336:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947605.461275:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947605.461298:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cad73be00/0x20c3e53e78bb1cde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaed7 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947605.461317:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947605.461383:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87f1f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d64dfe14-87c9-4273-a23c-517e593e369d+14:2353:x1870604297934336:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 129us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947605.461391:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:2.0:1783947605.461498:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:2.0:1783947605.461506:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d64dfe14-87c9-4273-a23c-517e593e369d+13:2353:x1870604297934208:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947605.461513:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947605.461523:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c80031c00/0x20c3e53e78bb1d78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf0f expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947605.461536:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947605.461555:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d64dfe14-87c9-4273-a23c-517e593e369d+12:2353:x1870604297934208:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 50us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947605.461560:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:2.0:1783947605.461573:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:2.0:1783947605.461579:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d64dfe14-87c9-4273-a23c-517e593e369d+11:2353:x1870604297934464:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947605.461587:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947605.461597:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cc0630e00/0x20c3e53e78bb1f8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafda expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947605.461605:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947605.461621:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d64dfe14-87c9-4273-a23c-517e593e369d+10:2353:x1870604297934464:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 42us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947605.461626:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:0.0:1783947605.463312:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947605.463494:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297934848 00000100:00100000:1.0:1783947605.463505:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297934848 00000100:00100000:1.0:1783947605.463581:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00100000:1.0:1783947605.463591:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+7:2352:x1870604297934848:12345-192.168.203.32@tcp:9:umount.0 00000020:00000080:1.0:1783947605.463634:0:6590:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb22b8 00000020:00010000:1.0:1783947605.463642:0:6590:0:(genops.c:1954:obd_stale_export_put()) Put export ffff8b3c84db7800: total 0 00000100:00080000:1.0:1783947605.463647:0:6590:0:(import.c:65:import_set_state_nolock()) ffff8b3c84db3000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783947605.463703:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:0.0:1783947605.464109:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783947605.464138:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947605.465497:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2352:x1870604297934848:12345-192.168.203.32@tcp:9:umount.0 Request processed in 1894us (2182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947605.465512:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 73 00000020:00010000:0.0:1783947605.466502:0:5786:0:(genops.c:1940:obd_stale_export_get()) Get export ffff8b3c84db7800: total 0 00010000:00010000:0.0:1783947605.466584:0:5786:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8b3c84db7800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1783947605.466661:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000087b9448/0x20c3e53e78bb2654 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1af expref: 4 pid: 8151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947605.466709:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079c72bfc/0x20c3e53e78bb2cf2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab37d expref: 3 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947605.466730:0:5786:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8b3c84db7800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1783947605.466744:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947605.466746:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947605.466748:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947605.471600:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947605.471734:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297934976 00000100:00100000:1.0:1783947605.471746:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297934976 00000100:00100000:1.0:1783947605.471843:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00100000:1.0:1783947605.471856:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+5:2352:x1870604297934976:12345-192.168.203.32@tcp:9:umount.0 00000020:00000080:1.0:1783947605.471917:0:6592:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb2050 00000100:00080000:1.0:1783947605.471927:0:6592:0:(import.c:65:import_set_state_nolock()) ffff8b3c90d68800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783947605.471986:0:6592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1783947605.472525:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1ed966c-3190-4795-821d-ae5dca7b5f51+2:2352:x1870604297934976:12345-192.168.203.32@tcp:9:umount.0 Request processed in 668us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947605.472535:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 74 00010000:00010000:3.0:1783947605.472676:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783947605.472762:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947605.481842:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947605.481976:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297936000 00000100:00100000:1.0:1783947605.481990:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297936000 00000100:00100000:1.0:1783947605.482103:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 240 00000100:00100000:1.0:1783947605.482115:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+22:2352:x1870604297936000:12345-192.168.203.32@tcp:39:umount.0 00000020:00000080:1.0:1783947605.482160:0:6613:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1cec 00000020:00010000:1.0:1783947605.482190:0:6613:0:(genops.c:1954:obd_stale_export_put()) Put export ffff8b3b85d9d000: total 0 00000100:00080000:1.0:1783947605.482196:0:6613:0:(import.c:65:import_set_state_nolock()) ffff8b3b8410e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783947605.482232:0:6613:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1783947605.482730:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1ed966c-3190-4795-821d-ae5dca7b5f51+21:2352:x1870604297936000:12345-192.168.203.32@tcp:39:umount.0 Request processed in 615us (901us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1783947605.482742:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 240 00000020:00010000:0.0:1783947605.482891:0:5786:0:(genops.c:1940:obd_stale_export_get()) Get export ffff8b3b85d9d000: total 0 00010000:00010000:0.0:1783947605.482896:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947605.482955:0:5786:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8b3b85d9d000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1783947605.482995:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b3c84bc6300) 00010000:00010000:0.0:1783947605.483000:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947605.483010:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631200/0x20c3e53e78bb1fd2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafef expref: 20 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947605.483038:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:0.0:1783947605.483041:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947605.483045:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb2615 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab19a expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947605.483059:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:0.0:1783947605.483061:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783947605.483083:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670c00/0x20c3e53e78bb263f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1a8 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947605.483103:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:0.0:1783947605.483105:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947605.483109:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825800/0x20c3e53e78bb2cb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab368 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947605.483132:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c82977500) 00010000:00010000:0.0:1783947605.483134:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947605.483138:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b000/0x20c3e53e78bb26b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1cb expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947605.483152:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:0.0:1783947605.483154:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783947605.483158:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631e00/0x20c3e53e78bb2cdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab376 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947605.483173:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:0.0:1783947605.483176:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783947605.483180:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb2313 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab0d6 expref: 14 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947605.483193:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b3c82977300) 00010000:00010000:0.0:1783947605.483195:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947605.483199:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ba00/0x20c3e53e78bb1fb6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafe8 expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947605.483217:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:0.0:1783947605.483225:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783947605.483231:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb29b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab2a4 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947605.483246:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:0.0:1783947605.483248:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947605.483252:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85670e00/0x20c3e53e78bb2bd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab330 expref: 11 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947605.483268:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b3c82977700) 00010000:00010000:0.0:1783947605.483271:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783947605.483274:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb26d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab1d2 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947605.483291:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b3c84af9100) 00010000:00010000:0.0:1783947605.483293:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947605.483297:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671c00/0x20c3e53e78bb2535 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab162 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947605.483313:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b3c8281bf00) 00010000:00010000:0.0:1783947605.483315:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783947605.483319:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671a00/0x20c3e53e78bb2026 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab004 expref: 8 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947605.483334:0:5786:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8b3b85d9d000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1783947605.483348:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947605.483350:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947605.483352:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947605.483911:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947605.561994:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319934720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947605.562182:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947605.562471:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319934720 00000100:00100000:3.0:1783947605.562483:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319934720 00000100:00100000:3.0:1783947605.562547:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783947605.562558:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319934720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783947605.562603:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783947605.568565:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319934720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5991us (6366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947605.568585:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783947605.570675:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319934720:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1783947605.625402:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d1ed966c-3190-4795-821d-ae5dca7b5f51 00000020:00000080:2.0:1783947605.625460:0:7509:0:(genops.c:906:class_export_put()) final put ffff8b3c84db7800/d1ed966c-3190-4795-821d-ae5dca7b5f51 00000020:00000080:3.0:1783947605.625589:0:12650:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3c84db7800/d1ed966c-3190-4795-821d-ae5dca7b5f51 for lustre-OST0001 00000020:00000080:3.0:1783947605.625748:0:12650:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3c84db3000 for lustre-OST0001 00010000:00010000:0.0:1783947606.329651:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947607.320445:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947607.320560:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947607.322684:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297936128 00000100:00100000:1.0:1783947607.322696:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297936128 00000100:00100000:3.0:1783947607.323317:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297936384 00000100:00100000:1.0:1783947607.323330:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:3.0:1783947607.323334:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297936384 00000100:00100000:1.0:1783947607.323348:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d64dfe14-87c9-4273-a23c-517e593e369d+11:2356:x1870604297936128:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947607.323367:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947607.323391:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cc0630000/0x20c3e53e78bb1dbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf24 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947607.323415:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:3.0:1783947607.323463:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d64dfe14-87c9-4273-a23c-517e593e369d+11:2356:x1870604297936384:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947607.323471:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947607.323481:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947607.323504:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c8147ce00/0x20c3e53e78bb1f85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aafd3 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947607.323527:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947607.323539:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d64dfe14-87c9-4273-a23c-517e593e369d+9:2356:x1870604297936128:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 194us (3122us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947607.323549:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:3.0:1783947607.323578:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d64dfe14-87c9-4273-a23c-517e593e369d+8:2356:x1870604297936384:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 119us (3015us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947607.323601:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:0.0:1783947607.324071:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947607.324183:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947607.324332:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297936256 00000100:00100000:2.0:1783947607.324340:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297936256 00000100:00100000:2.0:1783947607.324393:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:2.0:1783947607.324402:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d64dfe14-87c9-4273-a23c-517e593e369d+8:2356:x1870604297936256:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947607.324413:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947607.324441:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c8147da00/0x20c3e53e78bb1dc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf4e expref: 8 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947607.324456:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947607.324486:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d64dfe14-87c9-4273-a23c-517e593e369d+7:2356:x1870604297936256:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 86us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947607.324494:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:3.0:1783947607.324724:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297936640 00000100:00100000:3.0:1783947607.324736:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297936640 00000100:00100000:3.0:1783947607.324828:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 241 00000100:00100000:3.0:1783947607.324839:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+6:2352:x1870604297936640:12345-192.168.203.32@tcp:39:umount.0 00000020:00000080:3.0:1783947607.324900:0:5797:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1dd3 00000020:00010000:3.0:1783947607.324910:0:5797:0:(genops.c:1954:obd_stale_export_put()) Put export ffff8b3b84108000: total 0 00000100:00080000:3.0:1783947607.324916:0:5797:0:(import.c:65:import_set_state_nolock()) ffff8b3b8410d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783947607.324944:0:5797:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00080000:0.0:1783947607.325174:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1783947607.325220:0:5785:0:(genops.c:1940:obd_stale_export_get()) Get export ffff8b3b84108000: total 0 00010000:00010000:0.0:1783947607.325280:0:5785:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8b3b84108000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783947607.325318:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3c82977500) 00010000:00010000:0.0:1783947607.325323:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947607.325331:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cbd825c00/0x20c3e53e78bb2d00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab384 expref: 5 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947607.325359:0:5785:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8b3b84108000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1783947607.325371:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947607.325374:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947607.325376:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947607.325980:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aaa8892-ac73-492b-a5e2-3055ae3e2dca+3:2352:x1870604297936640:12345-192.168.203.32@tcp:39:umount.0 Request processed in 1139us (1791us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1783947607.325992:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 241 00000100:00100000:0.0:1783947607.349039:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947607.349205:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297936896 00000100:00100000:2.0:1783947607.349218:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297936896 00000100:00100000:2.0:1783947607.349298:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 307 00000100:00100000:2.0:1783947607.349310:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+7:2352:x1870604297936896:12345-192.168.203.32@tcp:251:umount.0 00000020:00000080:2.0:1783947607.349375:0:5791:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1cc9 00000020:00010000:2.0:1783947607.349385:0:5791:0:(genops.c:1954:obd_stale_export_put()) Put export ffff8b3cbd4d2000: total 0 00000100:00080000:2.0:1783947607.349391:0:5791:0:(import.c:65:import_set_state_nolock()) ffff8b3cbd4d5800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1783947607.349519:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64dfe14-87c9-4273-a23c-517e593e369d+3:2352:x1870604297936896:12345-192.168.203.32@tcp:251:umount.0 Request processed in 210us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947607.349528:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 307 00000020:00010000:0.0:1783947607.349868:0:5786:0:(genops.c:1940:obd_stale_export_get()) Get export ffff8b3cbd4d2000: total 0 00010000:00010000:0.0:1783947607.349874:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947607.349933:0:5786:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8b3cbd4d2000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783947607.349976:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c80030400/0x20c3e53e78bb1d7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852aaf16 expref: 2 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947607.349990:0:5786:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8b3cbd4d2000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1783947607.350000:0:5786:0:(genops.c:906:class_export_put()) final put ffff8b3cbd4d2000/d64dfe14-87c9-4273-a23c-517e593e369d 00010000:00010000:0.0:1783947607.350026:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947607.350029:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947607.350030:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947607.350038:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783947607.350143:0:12650:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cbd4d2000/d64dfe14-87c9-4273-a23c-517e593e369d for MGS 00000020:00000080:1.0:1783947607.350214:0:12650:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3cbd4d5800 for MGS 00010000:00010000:0.0:1783947607.353963:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947608.377517:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783947608.749535:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d1ed966c-3190-4795-821d-ae5dca7b5f51 00000020:00000080:3.0:1783947608.749545:0:6616:0:(genops.c:906:class_export_put()) final put ffff8b3c84c99000/d1ed966c-3190-4795-821d-ae5dca7b5f51 00000020:00000080:3.0:1783947608.749574:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3c84c99000/d1ed966c-3190-4795-821d-ae5dca7b5f51 for lustre-OST0000 00000020:00000080:3.0:1783947608.749625:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3c90d68800 for lustre-OST0000 00000020:01000004:0.0:1783947609.130750:0:12834:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783947609.154684:0:12834:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1783947609.154738:0:12834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c800/0x20c3e53e78bb1d4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947609.154754:0:12834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c800/0x20c3e53e78bb1d4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1d55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947609.154779:0:12834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c800/0x20c3e53e78bb1d4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1d55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947609.154786:0:12834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c800/0x20c3e53e78bb1d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1d55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947609.154808:0:12834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783947609.154814:0:12834:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783947609.154855:0:12834:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783947609.154861:0:12834:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783947609.154866:0:12834:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783947609.154894:0:12834:0:(import.c:65:import_set_state_nolock()) ffff8b3cbd986000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783947609.155039:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1870604319934848:0@lo:39:umount.0 00010000:00010000:1.0:1783947609.155095:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947609.155104:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c800/0x20c3e53e78bb1d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1d55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947609.155114:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147c800 already unused, calling callback (ffffffffc1b6dc20) 00000100:00100000:3.0:1783947609.155119:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1783947609.155121:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c800/0x20c3e53e78bb1d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1d55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947609.155133:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c800/0x20c3e53e78bb1d4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x20c3e53e78bb1d55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947609.155141:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c800/0x20c3e53e78bb1d4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x20c3e53e78bb1d55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947609.155148:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783947609.155152:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783947609.155155:0:5786:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783947609.155188:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c800/0x20c3e53e78bb1d4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1d55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947609.155195:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783947609.155314:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319934848 00000100:00100000:2.0:1783947609.155322:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319934848 00000100:00100000:2.0:1783947609.155378:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1783947609.155387:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1870604319934848:12345-0@lo:39:umount.0 00010000:00010000:1.0:1783947609.155412:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c800/0x20c3e53e78bb1d4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1d55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1783947609.155413:0:6613:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1ad8 00000100:00080000:2.0:1783947609.155443:0:6613:0:(import.c:65:import_set_state_nolock()) ffff8b3cc18ba800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1783947609.155502:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c800/0x20c3e53e78bb1d4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1d55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947609.155511:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1870604319934848:12345-0@lo:39:umount.0 Request processed in 124us (394us total) trans 0 rc 0/0 00010000:00010000:1.0:1783947609.155516:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947609.155519:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947609.155522:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00010000:00010000:1.0:1783947609.155523:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783947609.155536:0:6613:0:(genops.c:906:class_export_put()) final put ffff8b3cc18be800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1783947609.155545:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319934976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947609.155584:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783947609.155709:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783947609.155855:0:12650:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cc18be800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783947609.155917:0:12650:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3cc18ba800 for lustre-MDT0000 00000100:00080000:3.0:1783947609.155956:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3cbd986000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783947609.155966:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1870604319934848:0@lo:39:umount.0 00000100:00100000:2.0:1783947609.156407:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319934976 00000100:00100000:2.0:1783947609.156413:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319934976 00000100:00100000:2.0:1783947609.156509:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947609.156519:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319934976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947609.156531:0:8318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947609.156553:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c80030000/0x20c3e53e78bb1d55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20c3e53e78bb1d4e expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947609.156565:0:8318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947609.156606:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:3313:x1870604319934976:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947609.156613:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1783947609.156992:0:12834:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783947609.156997:0:12834:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783947609.157003:0:12834:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1783947609.157808:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319934976:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947609.158955:0:12834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1d5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947609.158970:0:12834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1d5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1d63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947609.158979:0:12834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1d5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1d63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947609.158986:0:12834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1d5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1d63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947609.159047:0:12834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783947609.159054:0:12834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b400/0x20c3e53e78bb1c83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1c8a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947609.159061:0:12834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b400/0x20c3e53e78bb1c83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1c8a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947609.159066:0:12834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b400/0x20c3e53e78bb1c83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1c8a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947609.159086:0:12834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b400/0x20c3e53e78bb1c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1c8a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947609.159144:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947609.159151:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1d5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1d63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947609.159157:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c80030600 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:1.0:1783947609.159161:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1d5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1d63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947609.159170:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1d5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x20c3e53e78bb1d63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947609.159177:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1d5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x20c3e53e78bb1d63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947609.159183:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783947609.159185:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1783947609.159236:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1d5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1d63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947609.159250:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947609.159284:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1d5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1d63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947609.159291:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3c80030600/0x20c3e53e78bb1d5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1d63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947609.159305:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947609.159308:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b400/0x20c3e53e78bb1c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1c8a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947609.159313:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1b400 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:1.0:1783947609.159316:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b400/0x20c3e53e78bb1c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1c8a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947609.159322:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b400/0x20c3e53e78bb1c83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x20c3e53e78bb1c8a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947609.159328:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b400/0x20c3e53e78bb1c83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x20c3e53e78bb1c8a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947609.159333:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1783947609.159335:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1783947609.159347:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b400/0x20c3e53e78bb1c83 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1c8a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947609.159353:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947609.159368:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b400/0x20c3e53e78bb1c83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1c8a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947609.159386:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947609.159388:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947609.159390:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947609.159399:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947609.159414:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319935104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947609.159508:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947609.159553:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319935232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947609.159575:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947609.159605:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319935104 00000100:00100000:1.0:1783947609.159610:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319935104 00000100:00100000:1.0:1783947609.159659:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319935232 00000100:00100000:1.0:1783947609.159662:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319935232 00000100:00100000:1.0:1783947609.159685:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783947609.159693:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c87f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+19:3313:x1870604319935104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947609.159705:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947609.159719:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c8147d800/0x20c3e53e78bb1d63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20c3e53e78bb1d5c expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947609.159731:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947609.159762:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c87f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+18:3313:x1870604319935104:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947609.159770:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783947609.159809:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783947609.159814:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:3311:x1870604319935232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947609.159821:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947609.159828:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3ca9d1b200/0x20c3e53e78bb1c8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20c3e53e78bb1c83 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947609.159859:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947609.159885:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:3311:x1870604319935232:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947609.159891:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783947609.159929:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3313:1870604319935104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947609.159950:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3311:1870604319935232:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947609.160264:0:12834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783947609.160270:0:12834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1b400/0x20c3e53e78bb1c83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1c8a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947609.160283:0:12834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1783947609.160291:0:12834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1f77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1f7e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947609.160299:0:12834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1f77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1f7e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947609.160305:0:12834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1f77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1f7e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947609.160311:0:12834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1f77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1f7e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947609.160356:0:12834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783947609.160362:0:12834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80031400/0x20c3e53e78bb1a37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1a3e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947609.160369:0:12834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80031400/0x20c3e53e78bb1a37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1a3e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947609.160375:0:12834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80031400/0x20c3e53e78bb1a37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1a3e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947609.160388:0:12834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff8b3c80031400/0x20c3e53e78bb1a37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1a3e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947609.160512:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783947609.160519:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1f77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1f7e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947609.160526:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73ac00 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:0.0:1783947609.160529:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1f77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1f7e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947609.160536:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1f77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x20c3e53e78bb1f7e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947609.160542:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1f77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x20c3e53e78bb1f7e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947609.160546:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783947609.160548:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783947609.160550:0:5786:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783947609.160570:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1f77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1f7e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947609.160576:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783947609.160602:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1f77 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1f7e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947609.160610:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cad73ac00/0x20c3e53e78bb1f77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1f7e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947609.160619:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947609.160622:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3c80031400/0x20c3e53e78bb1a37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1a3e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947609.160719:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319935360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947609.160755:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783947609.160830:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c80031400 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:0.0:1783947609.160833:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80031400/0x20c3e53e78bb1a37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1a3e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947609.160849:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3c80031400/0x20c3e53e78bb1a37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x20c3e53e78bb1a3e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947609.160855:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80031400/0x20c3e53e78bb1a37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x20c3e53e78bb1a3e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947609.160860:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1783947609.160862:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1783947609.160877:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3c80031400/0x20c3e53e78bb1a37 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1a3e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947609.160881:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783947609.160902:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3c80031400/0x20c3e53e78bb1a37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1a3e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947609.160910:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947609.160911:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947609.160913:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947609.160919:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947609.160926:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319935488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947609.160951:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783947609.161040:0:12834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783947609.161045:0:12834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3c80031400/0x20c3e53e78bb1a37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1a3e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947609.161057:0:12834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:2.0:1783947609.161061:0:12834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1783947609.161063:0:12834:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1783947609.161094:0:12834:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1783947609.161098:0:12834:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1783947609.161102:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783947609.161107:0:12834:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:2.0:1783947609.161112:0:12834:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8b3cb639a800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783947609.161118:0:12834:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8b3cb6185800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783947609.161125:0:12834:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff8b3b84108000 1aaa8892-ac73-492b-a5e2-3055ae3e2dca 192.168.203.32@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783947609.161130:0:12834:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff8b3b85d9d000 d1ed966c-3190-4795-821d-ae5dca7b5f51 192.168.203.32@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:2.0:1783947609.161135:0:12834:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff8b3cbda499c0) has exports, disconnecting them 00000020:00080000:2.0:1783947609.161139:0:12834:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8b3cb639a800), last request at 1783947605 00000020:00000080:2.0:1783947609.161146:0:12834:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1c4b 00000100:00080000:2.0:1783947609.161160:0:12834:0:(import.c:65:import_set_state_nolock()) ffff8b3cb6398800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783947609.161198:0:12834:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b3cb639a800): rc 0 00000020:00000080:2.0:1783947609.161201:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3cb639a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1783947609.161253:0:12834:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8b3cb6185800), last request at 1783947605 00000020:00000080:2.0:1783947609.161256:0:12834:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1b80 00000100:00080000:2.0:1783947609.161267:0:12834:0:(import.c:65:import_set_state_nolock()) ffff8b3cb6187800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783947609.161274:0:12834:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b3cb6185800): rc 0 00000020:00000080:2.0:1783947609.161276:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3cb6185800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:0.0:1783947609.161303:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947609.161325:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947609.161339:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319935360 00000100:00100000:1.0:1783947609.161345:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319935360 00000100:00100000:1.0:1783947609.161387:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319935488 00000100:00100000:1.0:1783947609.161390:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319935488 00000100:00100000:1.0:1783947609.161409:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783947609.161447:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+17:3312:x1870604319935360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947609.161457:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947609.161469:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cad73b200/0x20c3e53e78bb1f7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20c3e53e78bb1f77 expref: 17 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947609.161480:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947609.161516:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+16:3312:x1870604319935360:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947609.161522:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783947609.161534:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783947609.161540:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+15:3314:x1870604319935488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947609.161548:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947609.161555:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c813d0c00/0x20c3e53e78bb1a3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20c3e53e78bb1a37 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947609.161572:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947609.161597:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:3314:x1870604319935488:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947609.161604:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783947609.161649:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319935488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947609.161676:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319935360:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1783947609.161824:0:12650:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cb639a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783947609.161875:0:12650:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3cb6398800 for lustre-MDT0000 00000004:00000080:2.0:1783947609.161986:0:12834:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb28680d93ae0 00000100:00080000:2.0:1783947609.162007:0:12834:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783947609.162011:0:12834:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1783947609.162028:0:12834:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1783947609.162088:0:12834:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1783947609.162102:0:12834:0:(import.c:65:import_set_state_nolock()) ffff8b3ca035e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1783947609.162121:0:12834:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783947609.162124:0:12834:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1783947609.162134:0:12834:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1783947609.162203:0:12834:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1783947609.162214:0:12834:0:(import.c:65:import_set_state_nolock()) ffff8b3c8579d000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1783947609.162242:0:12834:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8b3cbda499c0) has no exports 00000100:00100000:3.0:1783947609.162496:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319935616:0@lo:9:umount.0 00000100:00100000:3.0:1783947609.162538:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947609.162562:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319935744:0@lo:9:umount.0 00000100:00100000:3.0:1783947609.162582:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947609.162659:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319935616 00000100:00100000:0.0:1783947609.162665:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319935616 00000100:00100000:0.0:1783947609.162711:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319935744 00000100:00100000:0.0:1783947609.162723:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319935744 00000100:00100000:0.0:1783947609.162745:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783947609.162751:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c879e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1870604319935616:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783947609.162771:0:6590:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1bdb 00000100:00080000:0.0:1783947609.162777:0:6590:0:(import.c:65:import_set_state_nolock()) ffff8b3b84a7e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783947609.162807:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000020:00000080:1.0:1783947609.162899:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cb6185800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783947609.162953:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3cb6187800 for lustre-MDT0000 00000100:00100000:1.0:1783947609.163020:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783947609.163030:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b856ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1870604319935744:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783947609.163046:0:6592:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1cb4 00000100:00080000:1.0:1783947609.163054:0:6592:0:(import.c:65:import_set_state_nolock()) ffff8b3b85d99000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783947609.163089:0:6592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1783947609.163205:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c879e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3310:x1870604319935616:12345-0@lo:9:umount.0 Request processed in 451us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947609.163213:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1783947609.163234:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783947609.163352:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947609.163358:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947609.163359:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b856ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3310:x1870604319935744:12345-0@lo:9:umount.0 Request processed in 329us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947609.163368:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1783947609.163388:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3ca035e000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783947609.163404:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783947609.163405:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783947609.163408:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319935616:0@lo:9:umount.0 00000100:00080000:3.0:1783947609.163448:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3c8579d000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783947609.163455:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783947609.163456:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783947609.163459:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319935744:0@lo:9:umount.0 00010000:00010000:1.0:1783947609.163868:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1783947609.172606:0:12834:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8b3cbda499c0) has no exports 00000020:00000080:2.0:1783947609.251917:0:12834:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1a92 00000020:00000080:2.0:1783947609.251933:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3cc0aec800/lustre-QMT0000_UUID 00000020:01000000:2.0:1783947609.251950:0:12834:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1783947609.252057:0:12650:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cc0aec800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1783947609.252082:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783947609.252092:0:12834:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783947609.252096:0:12834:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8b3cc18b4d40) has no exports 00000020:00000080:3.0:1783947609.252599:0:12834:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1a8b 00000020:00000080:3.0:1783947609.252607:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3cc18a2000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783947609.252665:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783947609.252672:0:12834:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783947609.252675:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3cc18a0800/lustre-QMT0000_UUID 00000020:00000080:3.0:1783947609.252677:0:12834:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cc18a0800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1783947609.252682:0:12834:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1783947609.252930:0:12650:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cc18a2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1783947609.401605:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947610.169704:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b856ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319935872:0@lo:400:kworker.0 00000100:00100000:1.0:1783947610.169777:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947610.169842:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319935872 00000100:00100000:2.0:1783947610.169852:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319935872 00000100:00100000:2.0:1783947610.169900:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1783947610.169909:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c832a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:3314:x1870604319935872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947610.172739:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319936000:0@lo:400:kworker.0 00000100:00100000:3.0:1783947610.172801:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947610.172856:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947610.172863:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319936128:0@lo:400:kworker.0 00000100:00100000:3.0:1783947610.172885:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947610.172910:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319936000 00000100:00100000:3.0:1783947610.172917:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319936000 00000100:00100000:3.0:1783947610.172950:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319936128 00000100:00100000:3.0:1783947610.172953:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319936128 00000100:00100000:3.0:1783947610.172970:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1783947610.172978:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1870604319936000:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783947610.172986:0:5795:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783947610.173024:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1870604319936000:12345-0@lo:400:kworker.0 Request processed in 46us (223us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783947610.173031:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1783947610.173045:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1783947610.173049:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1870604319936128:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783947610.173053:0:5795:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783947610.173075:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1870604319936128:12345-0@lo:400:kworker.0 Request processed in 24us (189us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783947610.174676:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1783947610.174746:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783947610.174752:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8b3c9e5ff800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783947610.174756:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1783947610.176439:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c832a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba+14:3314:x1870604319935872:12345-0@lo:400:kworker.0 Request processed in 6508us (6638us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947610.176452:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1783947610.177796:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b856ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319935872:0@lo:400:kworker.0 00000100:00080000:3.0:1783947610.209841:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8b3c9e5ff800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783947610.209853:0:3311:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 222 00000100:00080000:3.0:1783947610.209862:0:3311:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b3c9e5ff800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1783947610.209901:0:3311:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3cbd038000 x1870604319936256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783947610.209952:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319936128:0@lo:400:kworker.0 00000100:00080000:3.0:1783947610.210197:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783947610.210201:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8b3b84a7c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783947610.210205:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783947610.210208:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8b3b84a7c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783947610.210211:0:3311:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 201 00000100:00080000:3.0:1783947610.210215:0:3311:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b3b84a7c000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1783947610.210254:0:3311:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3b850d0000 x1870604319936384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783947610.210266:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319936000:0@lo:400:kworker.0 00000100:00100000:2.0:1783947610.211961:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1870604319936256:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1783947610.212035:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947610.212101:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1870604319936384:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1783947610.212125:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947610.212213:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319936256 00000100:00100000:0.0:1783947610.212222:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319936256 00000100:00100000:0.0:1783947610.212261:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319936384 00000100:00100000:0.0:1783947610.212264:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319936384 00000100:00100000:0.0:1783947610.212282:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783947610.212289:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1870604319936256:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1783947610.212306:0:5797:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783947610.212964:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1783947610.212971:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1870604319936384:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1783947610.212985:0:5795:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783947610.213037:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1870604319936384:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 64us (909us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783947610.213044:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1783947610.213088:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3b84a7c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783947610.213092:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783947610.213096:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1870604319936384:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783947610.227274:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1870604319936256:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 14977us (15231us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783947610.227287:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1783947610.227335:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3c9e5ff800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783947610.227340:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783947610.227344:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1870604319936256:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:3.0:1783947610.239621:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d1ed966c-3190-4795-821d-ae5dca7b5f51 00000001:00080000:3.0:1783947610.239638:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:3.0:1783947610.239664:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1aaa8892-ac73-492b-a5e2-3055ae3e2dca 00000001:00080000:3.0:1783947610.239684:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1783947610.239687:0:5819:0:(genops.c:906:class_export_put()) final put ffff8b3b84108000/1aaa8892-ac73-492b-a5e2-3055ae3e2dca 00000020:00000080:3.0:1783947610.239714:0:5819:0:(genops.c:906:class_export_put()) final put ffff8b3b85d9d000/d1ed966c-3190-4795-821d-ae5dca7b5f51 00000020:00000080:1.0:1783947610.239769:0:12650:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3b84108000/1aaa8892-ac73-492b-a5e2-3055ae3e2dca for lustre-MDT0000 00000020:00000080:1.0:1783947610.239843:0:12650:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3b85d9d000/d1ed966c-3190-4795-821d-ae5dca7b5f51 for lustre-MDT0000 00000020:00000080:1.0:1783947610.239882:0:12650:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3b8410d800 for lustre-MDT0000 00000020:00000080:1.0:1783947610.239893:0:12650:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3b8410e000 for lustre-MDT0000 00010000:00010000:1.0:1783947610.427057:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783947610.755495:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783947610.755504:0:7509:0:(genops.c:906:class_export_put()) final put ffff8b3b85d9c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783947610.755586:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3b85d9c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1783947610.755758:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3b85d99000 for lustre-OST0001 00000020:01000000:3.0:1783947611.257560:0:12834:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8b3c857fac00 - data ffff8b3cc0526948/ffff8b3b8418a000 00000020:01000000:3.0:1783947611.258209:0:12834:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8b3c98185600 - data ffff8b3ca10720d8/ffff8b3c8823f400 00000001:00000004:3.0:1783947611.269360:0:12834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1783947611.378155:0:12834:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783947611.378163:0:12834:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1783947611.378190:0:12834:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783947611.378193:0:12834:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783947611.378853:0:6747:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783947611.378859:0:6747:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1783947611.378869:0:6747:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1783947611.380109:0:12834:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783947611.380116:0:12834:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1783947611.380139:0:12834:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783947611.380141:0:12834:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783947611.380625:0:7805:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783947611.380630:0:7805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1783947611.380640:0:7805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1783947611.443727:0:12834:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1a5a 00000020:00000080:0.0:1783947611.443740:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3cbd982800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783947611.445167:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cbd982800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783947611.450988:0:12834:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1a6f 00000020:00000080:0.0:1783947611.451001:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3cbd985000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783947611.451013:0:12834:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1783947611.451019:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947611.451026:0:12834:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783947611.451030:0:12834:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8b3cbda48000) has no exports 00000004:01000000:0.0:1783947611.451193:0:12834:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1783947611.451201:0:12834:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1cad 00000020:00000080:0.0:1783947611.451205:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3b85d9b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783947611.451210:0:12834:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783947611.451213:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947611.451219:0:12834:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783947611.451221:0:12834:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff8b3cc18b0000) has no exports 00000020:00000080:0.0:1783947611.451227:0:12834:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1ca6 00000020:00000080:0.0:1783947611.451231:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3c85799000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1783947611.451576:0:12834:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783947611.451580:0:12834:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783947611.451585:0:12834:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1783947611.451590:0:12834:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783947611.451592:0:12834:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783947611.451619:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947611.451626:0:12834:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783947611.451631:0:12834:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1bc6 00000020:00000080:0.0:1783947611.451636:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3b84a7b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783947611.451640:0:12834:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783947611.451643:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947611.451647:0:12834:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783947611.451649:0:12834:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff8b3b84a8cd40) has no exports 00000020:00000080:0.0:1783947611.451653:0:12834:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1bbf 00000020:00000080:0.0:1783947611.451655:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3ca035a000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1783947611.451981:0:12834:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783947611.451984:0:12834:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783947611.451986:0:12834:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1783947611.451990:0:12834:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783947611.451991:0:12834:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783947611.452015:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947611.452021:0:12834:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783947611.452046:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947611.452050:0:12834:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783947611.452073:0:12834:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1a76 00000020:00000080:0.0:1783947611.452077:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3cbd985800/lustre-MDD0000_UUID 00000020:01000000:0.0:1783947611.452081:0:12834:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1783947611.452085:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947611.452088:0:12834:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783947611.452091:0:12834:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8b3cbda4cd40) has no exports 00000020:00000080:0.0:1783947611.452107:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947611.452111:0:12834:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1783947611.452114:0:12834:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1a7d 00000020:00000080:0.0:1783947611.452117:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3cbd983000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1783947611.452123:0:12834:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b3c85ce6800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1783947611.452127:0:12834:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b3c85ce6800 3 00000020:01000004:0.0:1783947611.452130:0:12834:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8b3c85ce6800 from lustre-MDT0000 00000020:00000080:0.0:1783947611.452147:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947611.452150:0:12834:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1783947611.452152:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3cbd980800/lustre-MDT0000_UUID 00000020:00000080:0.0:1783947611.452155:0:12834:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cbd980800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1783947611.452165:0:12834:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1783947611.452224:0:12834:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1783947611.452228:0:12834:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1783947611.452230:0:12834:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1783947611.452233:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947611.452236:0:12834:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783947611.452242:0:12834:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8b3c857b3800 bd1bc210-0230-4aa6-83fc-f49c3e4a8eba 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783947611.452253:0:12834:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8b3c85763380) has exports, disconnecting them 00000020:00080000:0.0:1783947611.452258:0:12834:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8b3c857b3800), last request at 1783947367 00000020:00000080:0.0:1783947611.452272:0:12834:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1a1b 00000020:00010000:0.0:1783947611.452275:0:12834:0:(genops.c:1954:obd_stale_export_put()) Put export ffff8b3c857b3800: total 7 00000100:00080000:0.0:1783947611.452278:0:12834:0:(import.c:65:import_set_state_nolock()) ffff8b3c857b2000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783947611.452295:0:12834:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b3c857b3800): rc 0 00000020:00080000:0.0:1783947611.452299:0:12834:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8b3c85763380) has no exports 00000020:00010000:0.0:1783947611.452312:0:5786:0:(genops.c:1940:obd_stale_export_get()) Get export ffff8b3c857b3800: total 7 00010000:00010000:0.0:1783947611.452335:0:5786:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8b3c857b3800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1783947611.452360:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cad73aa00/0x20c3e53e78bb1d2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20c3e53e78bb1d24 expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947611.452375:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c8147de00/0x20c3e53e78bb1d39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20c3e53e78bb1d32 expref: 8 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947611.452387:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cad73b800/0x20c3e53e78bb1f62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20c3e53e78bb1f5b expref: 7 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947611.452397:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cc0631400/0x20c3e53e78bb1d47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20c3e53e78bb1d40 expref: 6 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947611.452407:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3ca9d1b000/0x20c3e53e78bb1b33 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20c3e53e78bb1b2c expref: 5 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947611.452447:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c80030a00/0x20c3e53e78bb1d71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20c3e53e78bb1d6a expref: 4 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947611.452457:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cc0631600/0x20c3e53e78bb1f70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20c3e53e78bb1f69 expref: 3 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947611.452470:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cc0630400/0x20c3e53e78bb1d1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20c3e53e78bb1d16 expref: 2 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947611.452487:0:5786:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8b3c857b3800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1783947611.452501:0:5786:0:(genops.c:906:class_export_put()) final put ffff8b3c857b3800/bd1bc210-0230-4aa6-83fc-f49c3e4a8eba 00010000:00010000:0.0:1783947611.452506:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947611.452507:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947611.452509:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947611.456343:0:5789:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8b3c85682200:5789] 0 exiting: rc = 1 00000020:00000080:1.0:1783947611.456449:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cbd985000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1783947611.456457:0:36:0:(genops.c:906:class_export_put()) final put ffff8b3c9e5fd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783947611.456460:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3c9e5fd800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1783947611.456465:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783947611.456594:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3b85d9b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783947611.456600:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3c85799000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783947611.456605:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3c8579d000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783947611.456610:0:36:0:(genops.c:906:class_export_put()) final put ffff8b3ca035a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783947611.456612:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3ca035a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1783947611.456616:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783947611.456642:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3b84a7b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783947611.456646:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3ca035a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783947611.456651:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3ca035e000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783947611.456654:0:36:0:(genops.c:906:class_export_put()) final put ffff8b3b84a7c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783947611.456655:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3b84a7c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1783947611.456659:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783947611.456744:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cbd985800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1783947611.456749:0:36:0:(genops.c:906:class_export_put()) final put ffff8b3cbd983800/lustre-MDD0000_UUID 00000020:00000080:1.0:1783947611.456751:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cbd983800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1783947611.456754:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1783947611.456924:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cbd983000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783947611.456930:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3c857b3800/bd1bc210-0230-4aa6-83fc-f49c3e4a8eba for MGS 00000020:00000080:1.0:1783947611.456966:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3c857b2000 for MGS 00000100:00100000:2.0:1783947611.457183:0:5791:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8b3c85682000:5791] 2 exiting: rc = 0 00000100:00100000:2.0:1783947611.457251:0:5790:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8b3c85683400:5790] 1 exiting: rc = 0 00000100:00100000:3.0:1783947611.457566:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457575:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457581:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457587:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457597:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457603:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457609:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457614:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457620:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457626:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457631:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457637:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457641:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457646:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457652:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457657:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457672:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457677:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457682:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457688:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457694:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457700:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457705:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457711:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457716:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457720:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457725:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457730:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457735:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457740:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457746:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457751:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457756:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457761:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457766:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457771:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457775:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457780:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457787:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457792:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457798:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457802:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457807:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457812:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457816:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457832:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457838:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457842:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457847:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457853:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457858:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457870:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457876:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457881:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457886:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457893:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457898:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457903:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457908:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457914:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457920:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457925:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457930:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.457936:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1783947611.458285:0:12834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783947611.458289:0:12834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:0.0:1783947611.458718:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1783947611.464032:0:12834:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8b3b84a21960 - data ffff8b3ca13b4bd0/ffff8b3cb65d7800 00000020:01000000:1.0:1783947611.464153:0:12834:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8b3c85d349c0 - data ffff8b3ca107c000/ffff8b3cad671400 00000020:00000080:1.0:1783947611.464657:0:12834:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb19ff 00000020:00000080:1.0:1783947611.464664:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3ca0345000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783947611.464674:0:12834:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b3c85ce6800 from MGS, refs=2 00000020:01000004:1.0:1783947611.464677:0:12834:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b3c85ce6800 2 00000020:01000004:1.0:1783947611.464680:0:12834:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8b3c85ce6800 from MGS 00000020:00000080:1.0:1783947611.464698:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783947611.464704:0:12834:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1783947611.464707:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3ca0342000/MGS 00000020:00000080:1.0:1783947611.464710:0:12834:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3ca0342000/MGS for MGS 00000020:01000000:1.0:1783947611.464716:0:12834:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:3.0:1783947611.464862:0:12650:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3ca0345000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783947611.464939:0:12834:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1783947611.464943:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783947611.464949:0:12834:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783947611.464955:0:12834:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8b3cbd981000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783947611.464961:0:12834:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff8b3cbda4b380) has exports, disconnecting them 00000020:00080000:1.0:1783947611.464965:0:12834:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8b3cbd981000), last request at 1783947368 00000020:00000080:1.0:1783947611.464970:0:12834:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1aca 00000020:00080000:1.0:1783947611.464979:0:12834:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b3cbd981000): rc 0 00000020:00000080:1.0:1783947611.464984:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3cbd981000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783947611.466971:0:12650:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cbd981000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1783947611.469467:0:12834:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1783947611.469475:0:12834:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783947611.469479:0:12834:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783947611.469486:0:12834:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783947611.469631:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783947611.469639:0:12834:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1783947611.469657:0:12834:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b3c85ce6800 1 00000020:00000080:1.0:1783947611.469664:0:12834:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb19f1 00000020:00000080:1.0:1783947611.469672:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3ca0340000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1783947611.469677:0:12834:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1783947611.469681:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783947611.469685:0:12834:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783947611.469688:0:12834:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8b3c859719c0) has no exports 00000020:00000080:3.0:1783947611.469848:0:12650:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3cbd986000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783947611.469859:0:12650:0:(genops.c:906:class_export_put()) final put ffff8b3cbd984000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1783947611.469862:0:12650:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cbd984000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1783947611.469868:0:12650:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1783947611.469928:0:12650:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3ca0340000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783947611.499715:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783947611.499729:0:12834:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1783947611.499735:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3c85ce1000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783947611.499739:0:12834:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3c85ce1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783947611.499759:0:12834:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1783947611.499891:0:12834:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8b3c85ce3000 00000020:01000000:1.0:1783947611.499911:0:12834:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1783947611.499915:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783947611.499919:0:12834:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783947611.499923:0:12834:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff8b3c85973380) has no exports 00000100:00100000:3.0:1783947611.502072:0:5795:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8b3c8320ac00:5795] 0 exiting: rc = 1 00000100:00100000:3.0:1783947611.502167:0:5798:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8b3c8320a400:5798] 2 exiting: rc = 0 00000100:00100000:2.0:1783947611.502462:0:6613:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8b3b84a84800:6613] 3 exiting: rc = 0 00000100:00100000:0.0:1783947611.503076:0:5797:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8b3c8320b600:5797] 1 exiting: rc = 0 00000100:00100000:1.0:1783947611.503452:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503462:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503467:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503472:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503478:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503484:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503489:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503494:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503499:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503505:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503510:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503516:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503521:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503526:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503532:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503537:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503543:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503563:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503569:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503574:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503579:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503585:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503590:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503595:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503601:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503607:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503612:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503617:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503622:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503627:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503634:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503639:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503644:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503649:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503655:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503661:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503666:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503671:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503677:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503682:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503687:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503693:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503697:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503703:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503708:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503714:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503719:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503724:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503730:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503735:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503740:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503745:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503758:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503763:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503769:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503774:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503780:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503785:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503791:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503796:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503802:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503808:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503814:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.503830:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.512849:0:12341:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8b3b86540200:12341] 2 exiting: rc = 0 00000100:00100000:3.0:1783947611.513223:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8b3c8320b200:5799] 0 exiting: rc = 1 00000100:00100000:2.0:1783947611.513571:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8b3c8320aa00:5800] 1 exiting: rc = 0 00000100:00100000:3.0:1783947611.514120:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514129:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514135:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514142:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514147:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514152:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514159:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514176:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514181:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514187:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514193:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514200:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514209:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514215:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514221:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514227:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514233:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514238:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514244:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514249:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514254:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514259:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514264:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514269:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514274:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514279:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514284:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514290:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514296:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514301:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514306:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514311:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514315:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514320:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514326:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514331:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514336:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514342:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514346:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514351:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514356:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514361:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514375:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514379:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514384:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514389:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514395:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514400:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514406:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514410:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514484:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514491:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514496:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514502:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514507:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514512:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514516:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514521:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514526:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514531:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514535:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514541:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514546:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.514552:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.515891:0:5802:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8b3c857d1800:5802] 1 exiting: rc = 0 00000100:00100000:0.0:1783947611.516373:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8b3c85d0ce00:5801] 0 exiting: rc = 1 00000100:00100000:3.0:1783947611.516571:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516580:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516586:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516592:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516607:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516614:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516620:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516626:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516632:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516638:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516644:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516650:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516656:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516676:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516681:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516687:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516707:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516714:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516719:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516725:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516732:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516737:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516743:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516749:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516754:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516760:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516768:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516774:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516795:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516801:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516807:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516813:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516828:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516834:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516839:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516845:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516850:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516856:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516862:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516868:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516888:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516895:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516900:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516906:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516911:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516916:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516922:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516927:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516942:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516948:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516954:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.516959:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.517051:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.517060:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.517066:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.517072:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.517078:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.517084:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.517089:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.517095:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.517102:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.517108:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.517114:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.517120:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.528635:0:5803:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8b3c857d1a00:5803] 0 exiting: rc = 1 00000100:00100000:2.0:1783947611.528951:0:5804:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8b3c85d0c800:5804] 1 exiting: rc = 0 00000100:00100000:3.0:1783947611.529390:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529398:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529404:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529408:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529413:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529493:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529499:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529504:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529509:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529513:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529518:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529523:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529529:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529532:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529538:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529542:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529548:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529553:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529558:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529574:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529579:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529583:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529588:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529592:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529597:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529601:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529605:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529610:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529616:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529621:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529626:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529631:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529636:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529641:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529647:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529652:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529658:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529663:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529668:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529674:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529679:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529684:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529688:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529693:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529697:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529702:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529706:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529711:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529716:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529721:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529727:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529732:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529737:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529741:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529753:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529758:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529763:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529770:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529775:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529780:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529784:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529789:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529793:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.529798:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.530325:0:5806:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8b3c85d0c200:5806] 1 exiting: rc = 0 00000100:00100000:2.0:1783947611.530482:0:5805:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8b3c87ec8400:5805] 0 exiting: rc = 1 00000100:00100000:3.0:1783947611.530817:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530834:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530840:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530845:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530850:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530855:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530860:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530865:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530870:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530875:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530880:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530885:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530890:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530895:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530900:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530904:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530909:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530914:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530919:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530924:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530930:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530935:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530939:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530944:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530948:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530963:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530968:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.530973:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531050:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531055:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531060:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531065:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531069:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531074:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531078:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531083:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531090:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531095:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531099:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531104:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531109:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531114:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531119:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531124:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531129:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531133:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531138:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531143:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531148:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531153:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531157:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531162:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531167:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531172:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531177:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531182:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531187:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531191:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531196:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531201:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531215:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531219:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531223:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531228:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947611.531729:0:5808:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8b3c85d0d800:5808] 1 exiting: rc = 0 00000100:00100000:1.0:1783947611.531810:0:5807:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8b3c85d0c000:5807] 0 exiting: rc = 1 00000100:00100000:3.0:1783947611.531940:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531947:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531952:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531957:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531963:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531967:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531973:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531992:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.531997:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532002:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532008:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532014:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532020:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532025:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532030:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532035:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532040:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532045:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532051:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532057:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532062:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532067:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532072:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532077:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532082:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532087:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532093:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532098:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532103:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532109:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532115:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532130:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532136:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532141:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532146:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532152:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532156:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532162:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532167:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532172:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532179:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532184:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532189:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532195:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532200:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532206:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532212:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532216:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532222:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532227:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532233:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532238:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532243:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532248:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532253:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532259:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532264:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532270:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532275:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532280:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532286:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532290:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532295:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.532301:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947611.532870:0:5809:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8b3c85d0da00:5809] 0 exiting: rc = 1 00000100:00100000:0.0:1783947611.533088:0:5810:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8b3c85d0c600:5810] 1 exiting: rc = 0 00000100:00100000:1.0:1783947611.533649:0:5811:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8b3c85d0cc00:5811] 2 exiting: rc = 0 00000100:00100000:3.0:1783947611.533751:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533758:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533772:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533778:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533796:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533803:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533808:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533813:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533829:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533836:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533841:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533846:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533852:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533858:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533863:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533868:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533873:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533879:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533884:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533889:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533894:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533900:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533905:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533910:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533916:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533921:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533927:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533932:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533952:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533958:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533962:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533967:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533972:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533990:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.533996:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534002:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534007:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534019:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534025:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534030:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534036:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534043:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534048:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534053:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534058:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534066:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534071:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534079:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534084:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534091:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534097:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534102:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534120:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534126:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534132:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534137:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534143:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534148:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534153:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534159:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534164:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534170:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534175:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947611.534187:0:12834:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1783947611.538678:0:12834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783947611.538693:0:12834:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1783947611.538698:0:12834:0:(genops.c:906:class_export_put()) final put ffff8b3c85798000/MDS_uuid 00000020:00000080:3.0:1783947611.538702:0:12834:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3c85798000/MDS_uuid for MDS 00000020:01000000:3.0:1783947611.538713:0:12834:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1783947611.538840:0:12834:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1783947612.479478:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947613.498715:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783947613.820237:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783947613.820247:0:6616:0:(genops.c:906:class_export_put()) final put ffff8b3b84a7d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783947613.820295:0:12650:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3b84a7d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783947613.820346:0:12650:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3b84a7e800 for lustre-OST0000 00000020:01000004:0.0:1783947614.477835:0:12988:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783947614.494685:0:12988:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1783947614.494734:0:12988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb1d32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d39 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947614.494750:0:12988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb1d32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1d39 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947614.494757:0:12988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb1d32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1d39 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947614.494763:0:12988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb1d32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1d39 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947614.494831:0:12988:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783947614.494838:0:12988:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783947614.494862:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783947614.494867:0:12988:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783947614.494886:0:12988:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783947614.494893:0:12988:0:(import.c:65:import_set_state_nolock()) ffff8b3b84a7c000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1783947614.494898:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783947614.494900:0:12988:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783947614.494903:0:12988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783947614.495814:0:12988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c8147d200/0x20c3e53e78bb1d40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d47 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947614.495827:0:12988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c8147d200/0x20c3e53e78bb1d40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1d47 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947614.495834:0:12988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c8147d200/0x20c3e53e78bb1d40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1d47 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947614.495841:0:12988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff8b3c8147d200/0x20c3e53e78bb1d40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1d47 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947614.497115:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947614.497126:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb1d32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1d39 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947614.497135:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631c00 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:2.0:1783947614.497139:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb1d32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1d39 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947614.497157:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb1d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x20c3e53e78bb1d39 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947614.497165:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb1d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x20c3e53e78bb1d39 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947614.497171:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783947614.497174:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783947614.497177:0:5786:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783947614.497216:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb1d32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1d39 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947614.497239:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947614.497276:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb1d32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1d39 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947614.497283:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb1d32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1d39 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947614.497295:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947614.497309:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3c8147d200/0x20c3e53e78bb1d40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1d47 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947614.497315:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147d200 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:2.0:1783947614.497318:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3c8147d200/0x20c3e53e78bb1d40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1d47 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947614.497325:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3c8147d200/0x20c3e53e78bb1d40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x20c3e53e78bb1d47 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947614.497331:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3c8147d200/0x20c3e53e78bb1d40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x20c3e53e78bb1d47 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947614.497335:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783947614.497337:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1783947614.497350:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3c8147d200/0x20c3e53e78bb1d40 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1d47 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947614.497355:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947614.497361:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3c8147d200/0x20c3e53e78bb1d40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1d47 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947614.497377:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947614.497379:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947614.497381:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947614.497401:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319936640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947614.497481:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947614.497530:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947614.497536:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319936512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947614.497556:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947614.497586:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319936640 00000100:00100000:2.0:1783947614.497593:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319936640 00000100:00100000:2.0:1783947614.497627:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319936512 00000100:00100000:2.0:1783947614.497630:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319936512 00000100:00100000:2.0:1783947614.497652:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783947614.497658:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3314:x1870604319936640:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783947614.497664:0:5782:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783947614 with bad export cookie 2360982686148532763 00010000:00010000:0.0:1783947614.501661:0:12988:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783947614.501675:0:12988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3c8147d200/0x20c3e53e78bb1d40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1d47 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947614.501729:0:12988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c200/0x20c3e53e78bb1f69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1f70 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947614.501739:0:12988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c200/0x20c3e53e78bb1f69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1f70 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947614.501746:0:12988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c200/0x20c3e53e78bb1f69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1f70 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947614.501786:0:12988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c200/0x20c3e53e78bb1f69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1f70 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947614.501817:0:12988:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783947614.501823:0:12988:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1783947614.501830:0:12988:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1783947614.501859:0:12988:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1783947614.501864:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1783947614.501870:0:12988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947614.501875:0:12988:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783947614.501879:0:12988:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8b3cc18b3380) has no exports 00000020:00080000:0.0:1783947614.501903:0:12988:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8b3cc18b3380) has no exports 00010000:00010000:1.0:1783947614.503064:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947614.503075:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c200/0x20c3e53e78bb1f69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1f70 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947614.503084:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147c200 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:1.0:1783947614.503088:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c200/0x20c3e53e78bb1f69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1f70 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947614.503113:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c200/0x20c3e53e78bb1f69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x20c3e53e78bb1f70 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947614.503120:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c200/0x20c3e53e78bb1f69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x20c3e53e78bb1f70 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947614.503125:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783947614.503127:0:5785:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783947614.503130:0:5785:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783947614.503174:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c200/0x20c3e53e78bb1f69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1f70 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947614.503180:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947614.503213:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c200/0x20c3e53e78bb1f69 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1f70 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947614.503220:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3c8147c200/0x20c3e53e78bb1f69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x20c3e53e78bb1f70 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947614.503232:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947614.503233:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947614.503234:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947614.503282:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783947614.503290:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3314:x1870604319936512:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783947614.503296:0:8318:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783947614 with bad export cookie 2360982686148532763 00000100:00100000:1.0:1783947614.503387:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3314:x1870604319936512:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (5828us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783947614.503394:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783947614.503455:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947614.503476:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319936768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947614.503513:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947614.503549:0:8318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319936768 00000100:00100000:1.0:1783947614.503555:0:8318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319936768 00000100:00100000:1.0:1783947614.503582:0:8318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783947614.503586:0:8318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3312:x1870604319936768:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783947614.503590:0:8318:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783947614 with bad export cookie 2360982686148532763 00000100:00100000:1.0:1783947614.503633:0:8318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3312:x1870604319936768:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (119us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783947614.503639:0:8318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1783947614.503670:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783947614.503674:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8b3c8579a000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1783947614.503678:0:3312:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.132@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:0.0:1783947614.505862:0:12988:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8b3b84a218a0 - data ffff8b3ca106c288/ffff8b3cb65d5400 00000020:01000000:0.0:1783947614.506088:0:12988:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8b3c8668e420 - data ffff8b3c91316948/ffff8b3b85009800 00000100:00080000:3.0:1783947614.507402:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1783947614.512293:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3314:x1870604319936640:12345-0@lo:103:ldlm_bl.0 Request processed in 14626us (14805us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783947614.512366:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1783947614.515607:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783947614.535137:0:3312:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.132@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783947614.535203:0:3312:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783947614.535214:0:3312:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b3cb6aec700 x1870604319936640/t0(0) o103->MGC192.168.203.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783947630 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947614.535228:0:3312:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b3cb6aee300 x1870604319936512/t0(0) o103->MGC192.168.203.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783947630 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947614.535237:0:3312:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b3cb60a1500 x1870604319936768/t0(0) o103->MGC192.168.203.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783947630 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783947614.537859:0:3314:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8b3c8579a000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1783947614.537912:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319936640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947614.537940:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3314:1870604319936512:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1783947614.539214:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783947614.539222:0:3312:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783947614.539224:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1783947614.539228:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8b3c8579a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783947614.539235:0:3312:0:(import.c:510:import_select_connection()) MGC192.168.203.132@tcp: connect to NID 0@lo last attempt 183 00000100:00080000:1.0:1783947614.539244:0:3312:0:(import.c:624:import_select_connection()) MGC192.168.203.132@tcp: import ffff8b3c8579a000 using connection 192.168.203.132@tcp/0@lo 00010000:00010000:1.0:1783947614.539302:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947614.539483:0:3312:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3cb6aedf80 x1870604319936896/t0(0) o250->MGC192.168.203.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783947614.539525:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3312:1870604319936768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947614.539588:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3310:1870604319936896:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1783947614.539634:0:3310:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870604319936896 offset 0 length 520: 4 00100000:10000000:0.0:1783947614.561262:0:12988:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1783947614.597996:0:12988:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1b4f 00000020:00000080:3.0:1783947614.598005:0:12988:0:(genops.c:906:class_export_put()) final put ffff8b3b843c7800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1783947614.598025:0:12988:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b3cb6183000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1783947614.598028:0:12988:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b3cb6183000 2 00000020:01000004:3.0:1783947614.598031:0:12988:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8b3cb6183000 from lustre-OST0000 00000020:00000080:3.0:1783947614.598055:0:12988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783947614.598065:0:12988:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1783947614.598068:0:12988:0:(genops.c:906:class_export_put()) final put ffff8b3b843c3000/lustre-OST0000_UUID 00000020:00000080:3.0:1783947614.598070:0:12988:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3b843c3000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1783947614.598077:0:12988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1783947614.598119:0:12988:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1783947614.598123:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1783947614.598127:0:12988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783947614.598132:0:12988:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783947614.598139:0:12988:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8b3b84a78000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:0.0:1783947614.598495:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3b843c7800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:3.0:1783947614.598543:0:12988:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff8b3b84a899c0) has exports, disconnecting them 00000020:00080000:3.0:1783947614.598549:0:12988:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8b3b84a78000), last request at 1783947386 00000020:00000080:3.0:1783947614.598553:0:12988:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1b79 00000020:00080000:3.0:1783947614.598563:0:12988:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b3b84a78000): rc 0 00000020:00000080:3.0:1783947614.598569:0:12988:0:(genops.c:906:class_export_put()) final put ffff8b3b84a78000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1783947614.600547:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3b84a78000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1783947614.600810:0:12988:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1783947614.600815:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783947614.600820:0:12988:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783947614.600825:0:12988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783947614.600984:0:12988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947614.600993:0:12988:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1783947614.600999:0:12988:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b3cb6183000 1 00000020:00000080:2.0:1783947614.601005:0:12988:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1b09 00000020:00000080:2.0:1783947614.601012:0:12988:0:(genops.c:906:class_export_put()) final put ffff8b3cc0aed000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1783947614.601018:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1783947614.601024:0:12988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783947614.601028:0:12988:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783947614.601031:0:12988:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8b3c85970000) has no exports 00000020:00000080:0.0:1783947614.601617:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3b84a7c000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1783947614.601626:0:8:0:(genops.c:906:class_export_put()) final put ffff8b3b84a7d000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1783947614.601629:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3b84a7d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1783947614.601637:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1783947614.601699:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cc0aed000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1783947614.620528:0:12988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947614.620541:0:12988:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1783947614.620546:0:12988:0:(genops.c:906:class_export_put()) final put ffff8b3cb6990800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1783947614.620550:0:12988:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cb6990800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1783947614.620557:0:12988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1783947614.620688:0:12988:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8b3cb6181800 00000020:02000400:2.0:1783947614.620731:0:12988:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:1.0:1783947615.291269:0:12650:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd1bc210-0230-4aa6-83fc-f49c3e4a8eba->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783947615.291280:0:12650:0:(pinger.c:247:ptlrpc_pinger_process_import()) bd1bc210-0230-4aa6-83fc-f49c3e4a8eba->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783947615.291283:0:12650:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783947615.291286:0:12650:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783947615.291290:0:12650:0:(import.c:65:import_set_state_nolock()) ffff8b3c9e5ff800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783947615.291298:0:12650:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 425 00000100:00080000:1.0:1783947615.291303:0:12650:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783947615.291311:0:12650:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b3c9e5ff800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1783947615.291354:0:12650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3cb60a2d80 x1870604319937024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783947615.293483:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1870604319937024:0@lo:38:kworker.0 00000400:00000100:3.0:1783947615.293542:0:3310:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604319937024 offset 0 length 520: 4 00010000:00010000:0.0:1783947615.545647:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947616.569596:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947617.595013:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783947617.665390:0:13137:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783947617.683051:0:13137:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1783947617.683249:0:13137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030800/0x20c3e53e78bb1d16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d1d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947617.683268:0:13137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030800/0x20c3e53e78bb1d16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1d1d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947617.683276:0:13137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c80030800/0x20c3e53e78bb1d16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1d1d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947617.683283:0:13137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff8b3c80030800/0x20c3e53e78bb1d16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1d1d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947617.683345:0:13137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783947617.683351:0:13137:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783947617.683378:0:13137:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783947617.683391:0:13137:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b3cb60a2d80 x1870604319937024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783947630 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947617.683451:0:13137:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783947617.683458:0:13137:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783947617.683466:0:13137:0:(import.c:65:import_set_state_nolock()) ffff8b3c9e5ff800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1783947617.683471:0:13137:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783947617.683476:0:13137:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b3cb60a2d80 x1870604319937024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783947630 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947617.683483:0:13137:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783947617.683487:0:13137:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:3.0:1783947617.684169:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1870604319937024:0@lo:38:kworker.0 00010000:00010000:1.0:1783947617.685395:0:13137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb1d24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1d2b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947617.685414:0:13137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb1d24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1d2b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947617.685457:0:13137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb1d24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1d2b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947617.685464:0:13137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb1d24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1d2b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947617.685624:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783947617.685687:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3c80030800/0x20c3e53e78bb1d16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1d1d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947617.685697:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c80030800 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:0.0:1783947617.685701:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80030800/0x20c3e53e78bb1d16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1d1d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947617.685711:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3c80030800/0x20c3e53e78bb1d16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x20c3e53e78bb1d1d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947617.685719:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3c80030800/0x20c3e53e78bb1d16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x20c3e53e78bb1d1d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947617.685726:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783947617.685729:0:5785:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783947617.685732:0:5785:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783947617.685750:0:5785:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8b3c8579a000 00010000:00010000:0.0:1783947617.685754:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3c80030800/0x20c3e53e78bb1d16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x20c3e53e78bb1d1d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947617.685761:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3c80030800/0x20c3e53e78bb1d16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x20c3e53e78bb1d1d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947617.685785:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947617.685788:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb1d24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1d2b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947617.685794:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630600 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:0.0:1783947617.685796:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb1d24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1d2b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947617.685825:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb1d24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x20c3e53e78bb1d2b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947617.685832:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb1d24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x20c3e53e78bb1d2b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947617.685896:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783947617.685898:0:5785:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1783947617.685903:0:5785:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8b3c8579a000 00010000:00010000:0.0:1783947617.685906:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb1d24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x20c3e53e78bb1d2b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947617.685915:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947617.685917:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947617.685919:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947617.685991:0:13137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783947617.685996:0:13137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb1d24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x20c3e53e78bb1d2b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947617.686075:0:13137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb1f5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb1f62 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947617.686084:0:13137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb1f5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb1f62 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947617.686091:0:13137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb1f5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1f62 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947617.686097:0:13137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb1f5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x20c3e53e78bb1f62 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947617.686130:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947617.686135:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb1f5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1f62 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947617.686142:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670a00 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:0.0:1783947617.686145:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb1f5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x20c3e53e78bb1f62 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947617.686154:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb1f5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x20c3e53e78bb1f62 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947617.686161:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb1f5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x20c3e53e78bb1f62 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947617.686167:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783947617.686176:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1783947617.686181:0:5786:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8b3c8579a000 00010000:00010000:0.0:1783947617.686184:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb1f5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x20c3e53e78bb1f62 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947617.686195:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947617.686197:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947617.686199:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947617.686228:0:13137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783947617.686232:0:13137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb1f5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x20c3e53e78bb1f62 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947617.686262:0:13137:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1783947617.686267:0:13137:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1783947617.686270:0:13137:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1783947617.686299:0:13137:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1783947617.686305:0:13137:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1783947617.686311:0:13137:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783947617.686317:0:13137:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783947617.686322:0:13137:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8b3cbd3b8000) has no exports 00000020:00080000:2.0:1783947617.686351:0:13137:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8b3cbd3b8000) has no exports 00010000:00010000:0.0:1783947617.686524:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1783947617.691588:0:13137:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8b3b84a21720 - data ffff8b3ca104b798/ffff8b3b8418b800 00000020:01000000:2.0:1783947617.692709:0:13137:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8b3c88220ea0 - data ffff8b3ca13a9870/ffff8b3cc0a2bc00 00100000:10000000:2.0:1783947617.712393:0:13137:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1783947617.751833:0:13137:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1c1a 00000020:00000080:3.0:1783947617.751862:0:13137:0:(genops.c:906:class_export_put()) final put ffff8b3cbd4d2800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1783947617.751887:0:13137:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b3c83398800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1783947617.751891:0:13137:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b3c83398800 2 00000020:01000004:3.0:1783947617.751895:0:13137:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8b3c83398800 from lustre-OST0001 00000020:00000080:3.0:1783947617.751924:0:13137:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783947617.751947:0:13137:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1783947617.751951:0:13137:0:(genops.c:906:class_export_put()) final put ffff8b3cbd4d5000/lustre-OST0001_UUID 00000020:00000080:3.0:1783947617.751955:0:13137:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cbd4d5000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1783947617.751962:0:13137:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1783947617.752125:0:13137:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import bd1bc210-0230-4aa6-83fc-f49c3e4a8eba->MGS 00010000:00010000:3.0:1783947617.752144:0:13137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1bc00/0x20c3e53e78bb1b2c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x20c3e53e78bb1b33 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947617.752158:0:13137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1bc00/0x20c3e53e78bb1b2c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x20c3e53e78bb1b33 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947617.752164:0:13137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1783947617.752167:0:13137:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1783947617.752171:0:13137:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1783947617.752190:0:13137:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8b3c8579a000 00010000:00010000:3.0:1783947617.752194:0:13137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1bc00/0x20c3e53e78bb1b2c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x20c3e53e78bb1b33 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947617.752211:0:13137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1d6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x20c3e53e78bb1d71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947617.752218:0:13137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1d6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x20c3e53e78bb1d71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947617.752223:0:13137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783947617.752226:0:13137:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1783947617.752227:0:13137:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1783947617.752244:0:13137:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8b3c8579a000 00010000:00010000:3.0:1783947617.752247:0:13137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cad73a000/0x20c3e53e78bb1d6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x20c3e53e78bb1d71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783947617.752267:0:13137:0:(import.c:65:import_set_state_nolock()) ffff8b3c8579a000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1783947617.752272:0:13137:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1783947617.752274:0:13137:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1783947617.752276:0:13137:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1783947617.752281:0:13137:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1783947617.752296:0:13137:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b3cb6aedf80 x1870604319936896/t0(0) o250->MGC192.168.203.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783947624 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783947617.752314:0:13137:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783947617.752317:0:13137:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1783947617.752355:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd1bc210-0230-4aa6-83fc-f49c3e4a8eba:3310:1870604319936896:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:3.0:1783947617.752382:0:13137:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1783947617.752390:0:13137:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1a0d 00000020:00000080:3.0:1783947617.752395:0:13137:0:(genops.c:906:class_export_put()) final put ffff8b3c8579b800/bd1bc210-0230-4aa6-83fc-f49c3e4a8eba 00000020:01000000:3.0:1783947617.752401:0:13137:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.132@tcp (flags='') 00000020:00000080:3.0:1783947617.752408:0:13137:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783947617.752413:0:13137:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.132@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783947617.752458:0:13137:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff8b3c85974d40) has no exports 00000020:00000080:0.0:1783947617.752616:0:12650:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cbd4d2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1783947617.752625:0:12650:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3c8579b800/bd1bc210-0230-4aa6-83fc-f49c3e4a8eba for MGC192.168.203.132@tcp 10000000:01000000:0.0:1783947617.753521:0:5793:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1783947617.753654:0:13137:0:(obd_class.h:673:obd_cleanup_client_import()) MGC192.168.203.132@tcp: client import never connected 00000100:00080000:3.0:1783947617.753660:0:13137:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1783947617.753663:0:13137:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783947617.753667:0:13137:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1783947617.753670:0:13137:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1783947617.753729:0:13137:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783947617.753739:0:13137:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.132@tcp (uuid bd1bc210-0230-4aa6-83fc-f49c3e4a8eba) 00000020:01000000:3.0:1783947617.753747:0:13137:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1783947617.753754:0:13137:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783947617.753759:0:13137:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783947617.753768:0:13137:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8b3cbd4d7000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783947617.753798:0:13137:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff8b3cbd3b99c0) has exports, disconnecting them 00000020:00080000:3.0:1783947617.753804:0:13137:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8b3cbd4d7000), last request at 1783947407 00000020:00000080:3.0:1783947617.753809:0:13137:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1c44 00000020:00080000:3.0:1783947617.753825:0:13137:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b3cbd4d7000): rc 0 00000020:00000080:3.0:1783947617.753830:0:13137:0:(genops.c:906:class_export_put()) final put ffff8b3cbd4d7000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1783947617.754532:0:12650:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3c8579a000 for MGC192.168.203.132@tcp 00000020:00000080:0.0:1783947617.754541:0:12650:0:(genops.c:906:class_export_put()) final put ffff8b3c8579c000/bd1bc210-0230-4aa6-83fc-f49c3e4a8eba 00000020:00000080:0.0:1783947617.754544:0:12650:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3c8579c000/bd1bc210-0230-4aa6-83fc-f49c3e4a8eba for MGC192.168.203.132@tcp 00000020:01000000:0.0:1783947617.754552:0:12650:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.132@tcp (bd1bc210-0230-4aa6-83fc-f49c3e4a8eba) 00000020:00000080:0.0:1783947617.754832:0:12650:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cbd4d7000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1783947617.756775:0:13137:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1783947617.756793:0:13137:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783947617.756801:0:13137:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783947617.756811:0:13137:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783947617.758035:0:12650:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b3c9e5ff800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1783947617.758071:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1783947617.760100:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1783947617.760384:0:5780:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8b3c87f05600:5780] 0 exiting: rc = 1 00000100:00100000:0.0:1783947617.760529:0:5781:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8b3c87f05000:5781] 1 exiting: rc = 0 00000100:00100000:2.0:1783947617.760634:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.760943:0:5782:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8b3c87f7e600:5782] 0 exiting: rc = 1 00000100:00100000:0.0:1783947617.761086:0:5783:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8b3c87f04c00:5783] 1 exiting: rc = 0 00000100:00100000:0.0:1783947617.762102:0:8318:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8b3cbd4a8e00:8318] 3 exiting: rc = 0 00000100:00100000:1.0:1783947617.763019:0:5784:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8b3c87f7f000:5784] 2 exiting: rc = 0 00000100:00100000:2.0:1783947617.763227:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763236:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763244:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763251:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763257:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763263:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763270:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763278:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763285:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763293:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763299:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763326:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763333:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763339:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763346:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763353:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763360:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763365:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763371:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763376:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763382:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763387:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763393:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763399:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763406:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763411:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763448:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763455:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763461:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763466:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763472:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763477:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763482:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763488:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763492:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763498:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763504:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763509:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763516:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763522:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763528:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763534:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763539:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763545:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763551:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763556:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763570:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763575:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763581:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763587:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763593:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763598:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763603:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763609:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763614:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763620:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763626:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763630:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763636:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763642:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763647:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763653:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763658:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.763664:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1783947617.764705:0:13137:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947617.764719:0:13137:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1783947617.764726:0:13137:0:(genops.c:906:class_export_put()) final put ffff8b3cbd4d1800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1783947617.764732:0:13137:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cbd4d1800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1783947617.764739:0:13137:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1783947617.764809:0:13137:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b3c83398800 1 00000020:00000080:0.0:1783947617.764825:0:13137:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x20c3e53e78bb1be9 00000020:00000080:0.0:1783947617.764832:0:13137:0:(genops.c:906:class_export_put()) final put ffff8b3cb639b000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1783947617.764846:0:13137:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1783947617.764859:0:12650:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cb639b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1783947617.764876:0:13137:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947617.764882:0:13137:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783947617.764886:0:13137:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff8b3b84a8b380) has no exports 00000020:00000080:2.0:1783947617.785479:0:13137:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947617.785501:0:13137:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1783947617.785508:0:13137:0:(genops.c:906:class_export_put()) final put ffff8b3ca035e800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1783947617.785514:0:13137:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3ca035e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1783947617.785525:0:13137:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1783947617.785799:0:13137:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8b3ca035f000 00000020:01000000:2.0:1783947617.785831:0:13137:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1783947617.785837:0:13137:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783947617.785843:0:13137:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783947617.785848:0:13137:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8b3cbd3bb380) has no exports 00000020:00000080:2.0:1783947617.785876:0:13137:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947617.785883:0:13137:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1783947617.785887:0:13137:0:(genops.c:906:class_export_put()) final put ffff8b3cc0aec000/OSS_uuid 00000020:00000080:2.0:1783947617.785889:0:13137:0:(genops.c:865:class_export_destroy()) destroying export ffff8b3cc0aec000/OSS_uuid for OSS 00000020:01000000:2.0:1783947617.785893:0:13137:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1783947617.786005:0:8151:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8b3cb6542c00:8151] 3 exiting: rc = 0 00000100:00100000:2.0:1783947617.786149:0:6591:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8b3cbd372e00:6591] 1 exiting: rc = 0 00000100:00080000:2.0:1783947617.786611:0:5792:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1783947617.791596:0:6592:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8b3cad677000:6592] 2 exiting: rc = 0 00000100:00100000:2.0:1783947617.791625:0:6590:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8b3c8509fa00:6590] 0 exiting: rc = 1 00000100:00100000:0.0:1783947617.816832:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816848:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816866:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816878:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816884:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816890:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816896:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816901:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816906:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816913:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816919:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816924:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816930:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816936:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816942:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816948:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816954:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816962:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816968:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816974:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816981:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816987:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816992:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.816999:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817004:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817024:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817030:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817036:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817173:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817179:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817185:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817190:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817196:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817203:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817209:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817214:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817219:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817226:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817232:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817238:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817244:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817250:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817255:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817260:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817266:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817272:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817278:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817284:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817289:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817294:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817301:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817309:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817314:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817324:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817331:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817337:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817342:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817347:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817353:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817358:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817363:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817369:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817374:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.817387:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.820743:0:11568:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8b3cbd832200:11568] 2 exiting: rc = 0 00000100:00100000:3.0:1783947617.820958:0:6593:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8b3cad677c00:6593] 0 exiting: rc = 1 00000100:00100000:3.0:1783947617.821144:0:6594:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8b3cbd65dc00:6594] 1 exiting: rc = 0 00000100:00100000:0.0:1783947617.821291:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821311:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821319:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821325:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821331:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821337:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821342:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821348:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821354:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821360:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821365:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821372:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821377:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821382:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821387:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821393:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821399:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821405:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821412:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821540:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821549:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821555:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821561:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821566:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821572:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821833:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821839:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821845:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821851:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821856:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821862:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821867:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821872:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821878:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821905:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821910:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821916:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821921:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821926:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821932:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821938:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821944:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821949:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821955:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821961:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821967:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821972:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821978:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821983:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.821996:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.822003:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.822377:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.822385:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.822394:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.822407:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.822415:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.822562:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.822567:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.822637:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.822647:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.822652:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.822657:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.822729:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.822736:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947617.832369:0:6597:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8b3c85637400:6597] 2 exiting: rc = 0 00000100:00100000:2.0:1783947617.832838:0:6595:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8b3c85637000:6595] 0 exiting: rc = 1 00000100:00100000:3.0:1783947617.833175:0:6596:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8b3c85636a00:6596] 1 exiting: rc = 0 00000100:00100000:0.0:1783947617.833261:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833272:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833278:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833285:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833290:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833312:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833319:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833329:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833336:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833342:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833349:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833355:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833361:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833367:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833373:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833380:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833387:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833394:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833400:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833406:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833412:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833518:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833526:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833533:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833540:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833547:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833552:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833559:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833565:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833570:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833884:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833917:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833926:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833932:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833938:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833944:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833951:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833958:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833965:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833972:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833990:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.833996:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834002:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834008:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834014:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834020:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834027:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834033:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834108:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834116:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834122:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834129:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834135:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834143:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834150:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834157:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834164:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834181:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834190:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834197:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834204:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834210:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834217:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.834224:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947617.847104:0:6598:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8b3c85636800:6598] 0 exiting: rc = 1 00000100:00100000:2.0:1783947617.847830:0:6599:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8b3c857fd800:6599] 1 exiting: rc = 0 00000100:00100000:0.0:1783947617.847910:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.847918:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.847925:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.847930:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.847935:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.847940:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.847946:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.847952:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.847957:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.847962:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.847967:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.847999:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848005:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848010:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848015:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848020:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848026:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848032:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848046:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848053:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848060:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848066:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848071:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848077:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848082:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848087:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848093:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848098:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848103:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848108:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848114:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848119:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848124:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848130:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848135:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848140:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848145:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848150:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848156:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848161:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848166:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848171:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848176:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848181:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848186:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848190:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848206:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848212:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848216:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848222:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848228:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848233:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848238:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848243:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848248:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848254:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848259:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848264:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848269:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848274:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848280:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848285:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848290:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.848296:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947617.851858:0:6600:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8b3c857fcc00:6600] 0 exiting: rc = 1 00000100:00100000:3.0:1783947617.852497:0:6601:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8b3c857fd600:6601] 1 exiting: rc = 0 00000100:00100000:0.0:1783947617.852562:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852571:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852743:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852758:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852766:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852774:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852790:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852798:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852806:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852814:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852822:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852841:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852849:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852856:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852864:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852871:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852877:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852898:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852905:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852912:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852919:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852926:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852934:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852958:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852967:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852974:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852980:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852986:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852993:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.852999:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.853007:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.853015:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.853022:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.853028:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.853034:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.853066:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.853074:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.853080:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.853088:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.853095:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.853102:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.853108:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.853114:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.853120:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.853126:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.853132:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.853138:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.853415:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.854121:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.854128:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.854135:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.854143:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.854239:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.854247:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.854255:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.854262:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.854269:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.854276:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.854283:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.854309:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.854318:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.854324:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.854330:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947617.854336:0:13137:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1783947617.882932:0:13137:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1783947636.087213:0:13752:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1783947644.706386:0:14166:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783947644.706392:0:14166:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1783947644.706518:0:14166:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8b3cbd9ce000 00000020:01000004:3.0:1783947644.706534:0:14166:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1783947644.706541:0:14166:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783947644.706555:0:14166:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8b3c85760000) 00000020:00000080:3.0:1783947644.706571:0:14166:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1783947644.733618:0:14166:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1783947644.736958:0:14166:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1783947644.737343:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 525: rc = 0 00100000:10000000:1.0:1783947644.737727:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 525: rc = 0 00100000:10000000:1.0:1783947644.738082:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 525: rc = 0 00100000:10000000:1.0:1783947644.738268:0:14166:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1783947644.738338:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 525: rc = 0 00100000:10000000:1.0:1783947644.738792:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 525: rc = 0 00100000:10000000:1.0:1783947644.739078:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 525: rc = 0 00100000:10000000:1.0:1783947644.739338:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 527: rc = 0 00100000:10000000:1.0:1783947644.741029:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 52: rc = 0 00100000:10000000:1.0:1783947644.741134:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 52: rc = 0 00100000:10000000:1.0:1783947644.742292:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 668: rc = 0 00100000:10000000:1.0:1783947644.744987:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 668: rc = 0 00100000:10000000:1.0:1783947644.745243:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 668: rc = 0 00100000:10000000:1.0:1783947644.745628:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 668: rc = 0 00100000:10000000:1.0:1783947644.746066:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 668: rc = 0 00100000:10000000:1.0:1783947644.746317:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 668: rc = 0 00100000:10000000:1.0:1783947644.747682:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 668: rc = 0 00100000:10000000:1.0:1783947644.748158:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 668: rc = 0 00100000:10000000:1.0:1783947644.748738:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 668: rc = 0 00100000:10000000:1.0:1783947644.749204:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 668: rc = 0 00100000:10000000:1.0:1783947644.750047:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 668: rc = 0 00100000:10000000:1.0:1783947644.752269:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 668: rc = 0 00100000:10000000:1.0:1783947644.752905:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 414: rc = 0 00100000:10000000:1.0:1783947644.753314:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 414: rc = 0 00100000:10000000:1.0:1783947644.753616:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 414: rc = 0 00100000:10000000:1.0:1783947644.754781:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 414: rc = 0 00100000:10000000:1.0:1783947644.755315:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 414: rc = 0 00100000:10000000:1.0:1783947644.756677:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 414: rc = 0 00100000:10000000:1.0:1783947644.757010:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 414: rc = 0 00100000:10000000:1.0:1783947644.757701:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 414: rc = 0 00100000:10000000:1.0:1783947644.757962:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 414: rc = 0 00100000:10000000:1.0:1783947644.758250:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 414: rc = 0 00100000:10000000:1.0:1783947644.758551:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 414: rc = 0 00100000:10000000:1.0:1783947644.758810:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 414: rc = 0 00100000:10000000:1.0:1783947644.759062:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 414: rc = 0 00100000:10000000:1.0:1783947644.759356:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 414: rc = 0 00100000:10000000:2.0:1783947644.765025:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 414: rc = 0 00100000:10000000:2.0:1783947644.765333:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 414: rc = 0 00100000:10000000:2.0:1783947644.765747:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 414: rc = 0 00100000:10000000:2.0:1783947644.766080:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 414: rc = 0 00100000:10000000:2.0:1783947644.766305:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 414: rc = 0 00100000:10000000:2.0:1783947644.768707:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 414: rc = 0 00100000:10000000:2.0:1783947644.769054:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 414: rc = 0 00100000:10000000:2.0:1783947644.769405:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 414: rc = 0 00100000:10000000:2.0:1783947644.773961:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 414: rc = 0 00100000:10000000:2.0:1783947644.774280:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 414: rc = 0 00100000:10000000:2.0:1783947644.774702:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 414: rc = 0 00100000:10000000:2.0:1783947644.774961:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 414: rc = 0 00100000:10000000:2.0:1783947644.775206:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 414: rc = 0 00100000:10000000:2.0:1783947644.779372:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 414: rc = 0 00100000:10000000:2.0:1783947644.779700:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 414: rc = 0 00100000:10000000:2.0:1783947644.779962:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 414: rc = 0 00100000:10000000:2.0:1783947644.780201:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 414: rc = 0 00100000:10000000:2.0:1783947644.780461:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 414: rc = 0 00100000:10000000:2.0:1783947644.784325:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 56: rc = 0 00100000:10000000:2.0:1783947644.785968:0:14166:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1783947644.786156:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 53: rc = 0 00100000:10000000:2.0:1783947644.786346:0:14166:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1783947644.789983:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 53: rc = 0 00100000:10000000:2.0:1783947644.790331:0:14166:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1783947644.790413:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 53: rc = 0 00100000:10000000:2.0:1783947644.790845:0:14166:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1783947644.790920:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 405: rc = 0 00100000:10000000:2.0:1783947644.791103:0:14166:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1783947644.791173:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 405: rc = 0 00100000:10000000:2.0:1783947644.791358:0:14166:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1783947644.795122:0:14166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 405: rc = 0 00000020:00000080:2.0:1783947644.795504:0:14166:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783947644.795512:0:14166:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783947644.795522:0:14166:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20c3e53e78bb2d0e 00000020:01000004:2.0:1783947644.795531:0:14166:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1783947644.795536:0:14166:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783947644.795541:0:14166:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b3cbd9ce000 from MGS 00000020:01000004:2.0:1783947644.795544:0:14166:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783947644.795553:0:14166:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8b3cbd3bcd40) 00000020:00000080:2.0:1783947644.795563:0:14166:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1783947644.795630:0:14166:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b3cbd9ce000 from MGS, refs=2 00080000:01000000:2.0:1783947644.795635:0:14166:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783947644.795639:0:14166:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20c3e53e78bb2d1c 00000100:00100000:2.0:1783947644.795727:0:14166:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1783947644.795843:0:14166:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1783947644.795848:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1783947644.806564:0:14166:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1783947644.806580:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1783947644.807341:0:14166:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783947644.807548:0:14166:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1783947644.807553:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1783947644.811097:0:14166:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1783947644.811119:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1783947644.811678:0:14166:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1783947644.811698:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1783947644.812218:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947644.812222:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947644.812224:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947644.812467:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947644.812469:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947644.812471:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947644.813311:0:14166:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1783947644.826671:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1783947644.849078:0:14166:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1783947644.849099:0:14166:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783947644.849102:0:14166:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1783947644.858512:0:14175:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1783947644.860129:0:14166:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783947644.860243:0:14166:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783947644.860768:0:14166:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1783947644.861064:0:14166:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783947644.861208:0:14166:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1783947644.861213:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1783947644.873251:0:14166:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1783947644.873266:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1783947644.883760:0:14166:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1783947644.883772:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783947644.884414:0:14166:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783947644.884460:0:14166:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.132@tcp' 00000020:01000004:3.0:1783947644.884462:0:14166:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1783947644.884488:0:14166:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.132@tcp (typ=mgc) 00000020:00000080:3.0:1783947644.884500:0:14166:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.132@tcp (ffff8b3c857619c0) 00000020:00000080:3.0:1783947644.884514:0:14166:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1783947644.884577:0:14166:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b3c9e5f8800@MGC192.168.203.132@tcp: add connection 192.168.203.132@tcp at head 00010000:00010000:3.0:1783947644.884724:0:14166:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.132@tcp-0 is initialized 00000040:01000000:3.0:1783947644.884730:0:14166:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.132@tcp ctxt 1 is initialized 00000100:00080000:1.0:1783947644.884912:0:14180:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1783947644.889303:0:14182:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1783947644.889362:0:14166:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.132@tcp (uuid 9e11f6c7-2161-442e-ac38-f4342317f92b) 00000020:00000080:1.0:1783947644.889387:0:14166:0:(genops.c:1406:class_connect()) connect: client 9e11f6c7-2161-442e-ac38-f4342317f92b, cookie 0x20c3e53e78bb2d2a 00000100:00080000:1.0:1783947644.889399:0:14166:0:(import.c:510:import_select_connection()) MGC192.168.203.132@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783947644.889405:0:14166:0:(import.c:624:import_select_connection()) MGC192.168.203.132@tcp: import ffff8b3c9e5f8800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1783947644.889457:0:14166:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3cb60a1c00 x1870604319937152/t0(0) o250->MGC192.168.203.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783947644.889482:0:14166:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 9e11f6c7-2161-442e-ac38-f4342317f92b->MGS 00000020:01000004:1.0:1783947644.889499:0:14166:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1783947644.889520:0:14166:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1783947644.889535:0:14166:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8b3b84a8cd40) 00000020:00000080:1.0:1783947644.889547:0:14166:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1783947644.899705:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9e11f6c7-2161-442e-ac38-f4342317f92b:3310:1870604319937152:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783947644.899786:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947644.907489:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319937152 00000100:00100000:0.0:1783947644.907502:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319937152 00000100:00100000:0.0:1783947644.907550:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783947644.907559:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cc00ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1870604319937152:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1783947644.907588:0:14177:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 9e11f6c7-2161-442e-ac38-f4342317f92b@0@lo t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:0.0:1783947644.907634:0:14177:0:(genops.c:1406:class_connect()) connect: client 9e11f6c7-2161-442e-ac38-f4342317f92b, cookie 0x20c3e53e78bb2d38 00000100:00080000:0.0:1783947644.907767:0:14177:0:(import.c:65:import_set_state_nolock()) ffff8b3cbd51e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947644.907853:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cc00ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+5:3310:x1870604319937152:12345-0@lo:250:mount.lustre.0 Request processed in 294us (8067us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947644.907861:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947644.908011:0:3310:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.132@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783947644.908020:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.132@tcp: connect to target with instance 0 00000100:00080000:3.0:1783947644.908026:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.132@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783947644.908031:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783947644.908034:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3c9e5f8800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783947644.908037:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783947644.908051:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783947644.908056:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9e11f6c7-2161-442e-ac38-f4342317f92b:3310:1870604319937152:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1783947644.910366:0:14166:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947644.910708:0:14166:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1783947644.910715:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1783947644.911879:0:14166:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1783947644.911889:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1783947644.912291:0:14166:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1783947644.912298:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1783947644.913126:0:14166:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947644.913284:0:14166:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1783947644.913296:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1783947644.918344:0:14166:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1783947644.918681:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1783947644.944874:0:14166:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947644.945058:0:14166:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1783947644.945065:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1783947644.946211:0:14166:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1783947644.946221:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1783947644.946621:0:14166:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947644.946764:0:14166:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783947644.946768:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1783947644.947162:0:14166:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783947644.947169:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1783947644.947679:0:14166:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783947644.947815:0:14166:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783947644.947820:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1783947644.948155:0:14166:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783947644.948162:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1783947644.948730:0:14166:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783947644.948851:0:14166:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783947644.948855:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1783947644.949193:0:14166:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783947644.949198:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1783947644.965928:0:14166:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947644.966123:0:14166:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783947644.966129:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1783947644.967145:0:14166:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783947644.967154:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1783947644.967964:0:14166:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783947644.967972:0:14166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1783947644.969025:0:14166:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1783947644.969047:0:14166:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1783947644.969052:0:14166:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.132@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1783947644.969177:0:14166:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.132@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783947644.969208:0:14166:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.132@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1783947644.969212:0:14166:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783947644.969214:0:14166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783947644.969215:0:14166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947644.969216:0:14166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947644.969217:0:14166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947644.969219:0:14166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947644.969220:0:14166:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783947644.969222:0:14166:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783947644.969223:0:14166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947644.969224:0:14166:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783947644.969227:0:14166:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1783947644.969229:0:14166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783947644.969230:0:14166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783947644.969232:0:14166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947644.969233:0:14166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947644.969234:0:14166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947644.969235:0:14166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947644.969241:0:14166:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783947644.969242:0:14166:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783947644.969243:0:14166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947644.969244:0:14166:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783947644.969271:0:14166:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783947644.969293:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319937280:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783947644.969361:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947644.969444:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319937280 00000100:00100000:0.0:1783947644.969444:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85c829c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947644.969452:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319937280 00000100:00100000:1.0:1783947644.969498:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947644.969508:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+5:14166:x1870604319937280:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783947644.969559:0:14179:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783947644.969562:0:14179:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783947644.969565:0:14179:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1783947644.969866:0:14200:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783947644.970197:0:14179:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1783947644.971229:0:14201:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1783947644.971236:0:14201:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1783947644.971239:0:14201:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1783947644.971270:0:14201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1783947644.971966:0:14179:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783947644.971976:0:14179:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783947644.984353:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+5:14166:x1870604319937280:12345-0@lo:253:mount.lustre.0 Request processed in 14838us (14982us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947644.984368:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947644.989513:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319937280:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783947644.989533:0:14166:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783947644.989537:0:14166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783947644.989539:0:14166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783947644.989540:0:14166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947644.989541:0:14166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947644.989542:0:14166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947644.989543:0:14166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947644.989545:0:14166:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783947644.989546:0:14166:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783947644.989548:0:14166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947644.989549:0:14166:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783947644.989575:0:14166:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b3cbd9ce000 from lustre-MDT0000 10000000:01000000:0.0:1783947644.989616:0:14166:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1783947644.989620:0:14166:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783947644.989625:0:14166:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8b3c857619c0 10000000:01000000:0.0:1783947644.989629:0:14166:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783947644.989637:0:14166:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8b3c857619c0 from 1 10000000:01000000:0.0:1783947644.989641:0:14166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783947644.989873:0:14166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb2d3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947644.989900:0:14166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb2d3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947644.989910:0:14166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb2d3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947644.989931:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319937408:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783947644.989989:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947644.990034:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8820d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947644.990094:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319937408 00000100:00100000:2.0:1783947644.990101:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319937408 00000100:00100000:2.0:1783947644.990144:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783947644.990152:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+5:14166:x1870604319937408:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947644.990163:0:14178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947644.990176:0:14178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cc0631400/0x20c3e53e78bb2d46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb2d3f expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947644.990197:0:14178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cc0631400/0x20c3e53e78bb2d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb2d3f expref: 6 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947644.990208:0:14178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cc0631400/0x20c3e53e78bb2d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2d3f expref: 6 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947644.990217:0:14178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631400, rc 0) 00000100:00100000:2.0:1783947644.990263:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+6:14166:x1870604319937408:12345-0@lo:101:mount.lustre.0 Request processed in 111us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947644.990270:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947644.990499:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319937408:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947644.990513:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb2d3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2d46 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947644.990522:0:14166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb2d3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb2d46 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947644.990576:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319937536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947644.990614:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947644.990632:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8820d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947644.991783:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319937536 00000100:00100000:1.0:1783947644.991795:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319937536 00000100:00100000:1.0:1783947644.991854:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947644.991862:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+6:14166:x1870604319937536:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947644.992149:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+6:14166:x1870604319937536:12345-0@lo:501:mount.lustre.0 Request processed in 286us (1532us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783947644.992157:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783947644.992283:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319937536:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783947644.992320:0:14166:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783947644.992340:0:14166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb2d3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2d46 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947644.992351:0:14166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb2d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2d46 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947644.992361:0:14166:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b3cbd9ce000 10000000:01000000:3.0:1783947644.992366:0:14166:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783947644.992376:0:14166:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8b3cbd9ce000 10000000:01000000:3.0:1783947644.992379:0:14166:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783947644.992383:0:14166:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8b3cbd9ce000 from 1 10000000:01000000:3.0:1783947644.992385:0:14166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783947644.992443:0:14166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2d4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947644.992452:0:14166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2d4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947644.992461:0:14166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2d4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947644.992480:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319937664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783947644.992518:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947644.992549:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad6980c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947644.992569:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319937664 00000100:00100000:3.0:1783947644.992573:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319937664 00000100:00100000:3.0:1783947644.992609:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783947644.992617:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+6:14166:x1870604319937664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947644.992626:0:14178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947644.992641:0:14178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3ca9d1bc00/0x20c3e53e78bb2d54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb2d4d expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947644.992661:0:14178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3ca9d1bc00/0x20c3e53e78bb2d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb2d4d expref: 7 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947644.992683:0:14178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3ca9d1bc00/0x20c3e53e78bb2d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2d4d expref: 7 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947644.992703:0:14178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1bc00, rc 0) 00000100:00100000:3.0:1783947644.992735:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+7:14166:x1870604319937664:12345-0@lo:101:mount.lustre.0 Request processed in 119us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947644.992742:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783947644.992776:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319937664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947644.992788:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2d4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2d54 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947644.992796:0:14166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2d4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb2d54 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947644.992808:0:14166:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783947644.992812:0:14166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2d4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2d54 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947644.992819:0:14166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ba00/0x20c3e53e78bb2d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2d54 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947644.992824:0:14166:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783947644.992827:0:14166:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783947644.992832:0:14166:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8b3cbd9ce000 10000000:01000000:3.0:1783947644.992834:0:14166:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783947644.992838:0:14166:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783947644.992839:0:14166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783947644.992853:0:14166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb2d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947644.992870:0:14166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb2d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947644.992877:0:14166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb2d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947644.992888:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319937792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783947644.992913:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947644.992926:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad6980c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947644.992938:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319937792 00000100:00100000:3.0:1783947644.992941:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319937792 00000100:00100000:3.0:1783947644.992957:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783947644.992962:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+7:14166:x1870604319937792:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947644.992968:0:14178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947644.992976:0:14178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb2d62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb2d5b expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947644.992988:0:14178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb2d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb2d5b expref: 8 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947644.992996:0:14178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3ca9d1a600/0x20c3e53e78bb2d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2d5b expref: 8 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947644.993003:0:14178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a600, rc 0) 00000100:00100000:3.0:1783947644.993027:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+8:14166:x1870604319937792:12345-0@lo:101:mount.lustre.0 Request processed in 64us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947644.993033:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783947644.993064:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319937792:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947644.993074:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb2d5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2d62 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947644.993081:0:14166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb2d5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb2d62 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947644.993118:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319937920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947644.993141:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947644.993152:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad6980c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947644.993162:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319937920 00000100:00100000:3.0:1783947644.993165:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319937920 00000100:00100000:3.0:1783947644.993178:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783947644.993183:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+8:14166:x1870604319937920:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947644.993512:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+9:14166:x1870604319937920:12345-0@lo:501:mount.lustre.0 Request processed in 327us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947644.993519:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783947644.993547:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319937920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947644.993570:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319938048:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783947644.993615:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947644.993626:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad6980c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947644.993638:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319938048 00000100:00100000:3.0:1783947644.993641:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319938048 00000100:00100000:3.0:1783947644.993655:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783947644.993660:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+9:14166:x1870604319938048:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783947644.996305:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+9:14166:x1870604319938048:12345-0@lo:503:mount.lustre.0 Request processed in 2634us (2679us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947644.996331:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783947644.996526:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319938048:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783947644.999628:0:14202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9e11f6c7-2161-442e-ac38-f4342317f92b:14202:1870604319938176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947644.999794:0:14202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947644.999937:0:14202:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8820dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783947644.999986:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319938176 00000100:00100000:3.0:1783947644.999993:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319938176 00000100:00100000:3.0:1783947645.000093:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783947645.000103:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+9:14202:x1870604319938176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947645.000523:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+9:14202:x1870604319938176:12345-0@lo:502:llog_process_th.0 Request processed in 420us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947645.000531:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783947645.000792:0:14202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9e11f6c7-2161-442e-ac38-f4342317f92b:14202:1870604319938176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783947645.000832:0:14202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947645.000843:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947645.000851:0:14202:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783947645.000857:0:14202:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783947645.000861:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783947645.000876:0:14202:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8b3cc18b19c0) 00000020:00000080:0.0:1783947645.000896:0:14202:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1783947645.000901:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783947645.000965:0:14202:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783947645.000972:0:14202:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20c3e53e78bb2d70 00000020:00000080:0.0:1783947645.001323:0:14202:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783947645.001329:0:14202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947645.001333:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947645.001334:0:14202:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783947645.001337:0:14202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947645.001341:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947645.001342:0:14202:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783947645.001345:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783947645.001354:0:14202:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8b3cc18b3380) 00000020:00000080:0.0:1783947645.001364:0:14202:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1783947645.001368:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783947645.001370:0:14202:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783947645.001373:0:14202:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783947645.001379:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783947645.001440:0:14202:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b3cbd9ce000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783947645.001453:0:14202:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8b3cc18b0000) 00000020:00000080:0.0:1783947645.001460:0:14202:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1783947645.001502:0:14202:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783947645.001506:0:14202:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20c3e53e78bb2d85 00000020:00000080:0.0:1783947645.001605:0:14202:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783947645.001612:0:14202:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783947645.001616:0:14202:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x20c3e53e78bb2d8c 00080000:01000000:0.0:1783947645.001621:0:14202:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783947645.001624:0:14202:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20c3e53e78bb2d93 00010000:00010000:2.0:1783947645.074787:0:14202:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1783947645.075209:0:14202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1783947645.075390:0:14202:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783947645.077729:0:14202:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8b3cbd3bb380) 00000020:00000080:2.0:1783947645.077752:0:14202:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783947645.077827:0:14202:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783947645.077833:0:14202:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20c3e53e78bb2da1 00000020:00000080:3.0:1783947645.086955:0:14202:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783947645.096137:0:14202:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x20c3e53e78bb2da8 00000020:00000080:2.0:1783947645.097123:0:14202:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783947645.097136:0:14202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947645.097144:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947645.097146:0:14202:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783947645.097149:0:14202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783947645.097152:0:14202:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1783947645.097153:0:14202:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783947645.097155:0:14202:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783947645.097156:0:14202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783947645.097159:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947645.097160:0:14202:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783947645.097163:0:14202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947645.097168:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947645.097169:0:14202:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783947645.097174:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783947645.097214:0:14202:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783947645.097235:0:14202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947645.097238:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947645.097240:0:14202:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1783947645.097242:0:14202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783947645.097245:0:14202:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1783947645.097248:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947645.097250:0:14202:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783947645.097253:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783947645.097258:0:14202:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.132@tcp to nid 0x20000c0a8cb84 (192.168.203.132@tcp) 00000020:01000000:2.0:1783947645.097285:0:14202:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783947645.097298:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783947645.097314:0:14202:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8b3cbd3b99c0) 00000020:00000080:2.0:1783947645.097331:0:14202:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1783947645.097336:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783947645.097387:0:14202:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783947645.097392:0:14202:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783947645.097398:0:14202:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20c3e53e78bb2db6 00010000:00080000:2.0:1783947645.097464:0:14202:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b3c9e6c6000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:2.0:1783947645.097877:0:14202:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1783947645.098230:0:14202:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783947645.098276:0:14202:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783947645.101091:0:14202:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947645.101243:0:14202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1783947645.101818:0:14202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1783947645.102339:0:14206:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783947645.102345:0:14206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1783947645.103606:0:14202:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783947645.103618:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783947645.103650:0:14202:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783947645.103738:0:14202:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20c3e53e78bb2dbd 00000100:00080000:0.0:1783947645.103750:0:14202:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783947645.103755:0:14202:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8b3c9e6c6000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1783947645.103790:0:14202:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3cbd4b8e00 x1870604319938304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783947645.103852:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319938304:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783947645.103905:0:3310:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604319938304 offset 0 length 520: 4 00000100:00080000:0.0:1783947645.104015:0:14202:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1783947645.104281:0:14202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947645.104286:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947645.104288:0:14202:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783947645.104291:0:14202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783947645.104293:0:14202:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1783947645.104295:0:14202:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783947645.104297:0:14202:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783947645.104298:0:14202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783947645.104300:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947645.104302:0:14202:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783947645.104304:0:14202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783947645.104309:0:14202:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1783947645.104312:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947645.104313:0:14202:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1783947645.104316:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783947645.104320:0:14202:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.132@tcp to nid 0x20000c0a8cb84 (192.168.203.132@tcp) 00000020:01000000:0.0:1783947645.104343:0:14202:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783947645.104346:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783947645.104357:0:14202:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8b3cc18b4d40) 00000020:00000080:0.0:1783947645.104369:0:14202:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1783947645.104373:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783947645.104458:0:14202:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1783947645.104471:0:14202:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1783947645.104477:0:14202:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20c3e53e78bb2dcb 00010000:00080000:0.0:1783947645.104513:0:14202:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b3c8579e000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:0.0:1783947645.104725:0:14202:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1783947645.104900:0:14202:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783947645.104919:0:14202:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783947645.106003:0:14202:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947645.106069:0:14202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1783947645.106549:0:14202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1783947645.107087:0:14208:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783947645.107092:0:14208:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783947645.108046:0:14202:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783947645.108058:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783947645.108087:0:14202:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783947645.108103:0:14202:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20c3e53e78bb2dd2 00000100:00080000:0.0:1783947645.108262:0:14202:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783947645.108269:0:14202:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8b3c8579e000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1783947645.108303:0:14202:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3cbd4bad80 x1870604319938432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783947645.108365:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319938432:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783947645.108415:0:3310:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604319938432 offset 0 length 520: 4 00000100:00080000:0.0:1783947645.108509:0:14202:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1783947645.108557:0:14202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947645.108561:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947645.108563:0:14202:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783947645.108566:0:14202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947645.108569:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947645.108571:0:14202:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783947645.108574:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783947645.108576:0:14202:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783947645.108578:0:14202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947645.108581:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947645.108582:0:14202:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783947645.108585:0:14202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947645.108587:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947645.108605:0:14202:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783947645.108611:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783947645.108641:0:14202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9e11f6c7-2161-442e-ac38-f4342317f92b:14202:1870604319938560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947645.108703:0:14202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947645.108737:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319938560 00000100:00100000:0.0:1783947645.108743:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319938560 00000100:00100000:0.0:1783947645.108779:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783947645.108788:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+9:14202:x1870604319938560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947645.109015:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+9:14202:x1870604319938560:12345-0@lo:502:llog_process_th.0 Request processed in 227us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947645.109023:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783947645.109065:0:14202:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c857da240 going to sleep for 11 seconds 00000100:00100000:0.0:1783947645.109086:0:14202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9e11f6c7-2161-442e-ac38-f4342317f92b:14202:1870604319938560:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783947645.109799:0:14202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947645.109808:0:14202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947645.109809:0:14202:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783947645.109814:0:14202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1783947645.109970:0:14166:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1783947645.109989:0:14166:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783947645.110011:0:14166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb2d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2d62 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.110022:0:14166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1a000/0x20c3e53e78bb2d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2d62 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947645.110029:0:14166:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8b3cbd9ce000 from 1 10000000:01000000:2.0:1783947645.110031:0:14166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783947645.110061:0:14166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631600/0x20c3e53e78bb2dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.110068:0:14166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631600/0x20c3e53e78bb2dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.110078:0:14166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631600/0x20c3e53e78bb2dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947645.110104:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319938688:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783947645.110158:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947645.110185:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8820c840 going to sleep for 11 seconds 00000100:00100000:1.0:1783947645.110329:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319938688 00000100:00100000:1.0:1783947645.110337:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319938688 00000100:00100000:1.0:1783947645.110376:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783947645.110385:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+9:14166:x1870604319938688:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947645.110395:0:14179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947645.110410:0:14179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cbd824a00/0x20c3e53e78bb2de0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb2dd9 expref: -99 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947645.110468:0:14179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cbd824a00/0x20c3e53e78bb2de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb2dd9 expref: 10 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947645.110476:0:14179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cbd824a00/0x20c3e53e78bb2de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2dd9 expref: 10 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947645.110484:0:14179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cbd824a00, rc 0) 00000100:00100000:1.0:1783947645.110518:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+10:14166:x1870604319938688:12345-0@lo:101:mount.lustre.0 Request processed in 135us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947645.110524:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783947645.110643:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319938688:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947645.110656:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631600/0x20c3e53e78bb2dd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2de0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.110675:0:14166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631600/0x20c3e53e78bb2dd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb2de0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947645.111332:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319938816:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1783947645.111377:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947645.111620:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8820c840 going to sleep for 11 seconds 00000100:00100000:1.0:1783947645.111677:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319938816 00000100:00100000:1.0:1783947645.111683:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319938816 00000100:00100000:1.0:1783947645.111711:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783947645.111718:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+10:14166:x1870604319938816:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1783947645.111735:0:14179:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783947645.111741:0:14179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1783947645.112091:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+10:14166:x1870604319938816:12345-0@lo:256:mount.lustre.0 Request processed in 372us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947645.112105:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783947645.112131:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319938816:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1783947645.112754:0:14166:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783947645.112780:0:14166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631600/0x20c3e53e78bb2dd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2de0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.112790:0:14166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631600/0x20c3e53e78bb2dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2de0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947645.112798:0:14166:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3cbd9ce000 from 1 10000000:01000000:2.0:1783947645.112801:0:14166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783947645.112830:0:14166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630400/0x20c3e53e78bb2de7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.112850:0:14166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630400/0x20c3e53e78bb2de7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.112859:0:14166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630400/0x20c3e53e78bb2de7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947645.112876:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319938944:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783947645.112910:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947645.112935:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8820c840 going to sleep for 11 seconds 00000100:00100000:1.0:1783947645.113085:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319938944 00000100:00100000:1.0:1783947645.113091:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319938944 00000100:00100000:1.0:1783947645.113169:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783947645.113178:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+10:14166:x1870604319938944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947645.113189:0:14177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947645.113201:0:14177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cbd825200/0x20c3e53e78bb2dee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb2de7 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947645.113220:0:14177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cbd825200/0x20c3e53e78bb2dee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb2de7 expref: 11 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947645.113228:0:14177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cbd825200/0x20c3e53e78bb2dee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2de7 expref: 11 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947645.113235:0:14177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cbd825200, rc 0) 00000100:00100000:1.0:1783947645.113273:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+11:14166:x1870604319938944:12345-0@lo:101:mount.lustre.0 Request processed in 97us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947645.113278:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783947645.113340:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319938944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947645.113351:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630400/0x20c3e53e78bb2de7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2dee expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.113359:0:14166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630400/0x20c3e53e78bb2de7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb2dee expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947645.113408:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319939072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947645.113462:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947645.113686:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8820c840 going to sleep for 11 seconds 00000100:00100000:3.0:1783947645.113750:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319939072 00000100:00100000:3.0:1783947645.113756:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319939072 00000100:00100000:3.0:1783947645.113777:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783947645.113784:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+11:14166:x1870604319939072:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947645.114151:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+11:14166:x1870604319939072:12345-0@lo:501:mount.lustre.0 Request processed in 366us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947645.114159:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783947645.114272:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319939072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947645.114304:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319939200:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947645.114342:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947645.114368:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8820c840 going to sleep for 11 seconds 00000100:00100000:1.0:1783947645.114571:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319939200 00000100:00100000:1.0:1783947645.114576:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319939200 00000100:00100000:1.0:1783947645.114616:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783947645.114624:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+11:14166:x1870604319939200:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947645.114780:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+11:14166:x1870604319939200:12345-0@lo:503:mount.lustre.0 Request processed in 157us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947645.114787:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783947645.115045:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319939200:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947645.115413:0:14210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9e11f6c7-2161-442e-ac38-f4342317f92b:14210:1870604319939328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947645.115559:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947645.115586:0:14210:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b85d93840 going to sleep for 11 seconds 00000100:00100000:0.0:1783947645.115824:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319939328 00000100:00100000:0.0:1783947645.115831:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319939328 00000100:00100000:0.0:1783947645.115862:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783947645.115871:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+11:14210:x1870604319939328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947645.116097:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+11:14210:x1870604319939328:12345-0@lo:502:llog_process_th.0 Request processed in 227us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947645.116105:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783947645.116127:0:14210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9e11f6c7-2161-442e-ac38-f4342317f92b:14210:1870604319939328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783947645.116160:0:14210:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947645.116169:0:14210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947645.116172:0:14210:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783947645.116180:0:14210:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b3cbd9ce000 00000020:00000080:3.0:1783947645.116182:0:14210:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783947645.116190:0:14210:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947645.116193:0:14210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947645.116195:0:14210:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783947645.116197:0:14210:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947645.116199:0:14210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947645.116200:0:14210:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783947645.116203:0:14210:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b3cbd9ce000 00000020:00000080:3.0:1783947645.116205:0:14210:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783947645.116273:0:14210:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947645.116277:0:14210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947645.116278:0:14210:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783947645.116281:0:14210:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947645.116283:0:14210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947645.116285:0:14210:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783947645.116289:0:14210:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b3cbd9ce000 00000020:00000080:3.0:1783947645.116290:0:14210:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783947645.116326:0:14210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9e11f6c7-2161-442e-ac38-f4342317f92b:14210:1870604319939456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947645.116362:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947645.116393:0:14210:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cad698f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947645.116455:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319939456 00000100:00100000:2.0:1783947645.116464:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319939456 00000100:00100000:2.0:1783947645.116487:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783947645.116493:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+11:14210:x1870604319939456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947645.116649:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+11:14210:x1870604319939456:12345-0@lo:502:llog_process_th.0 Request processed in 155us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947645.116656:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783947645.116997:0:14210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9e11f6c7-2161-442e-ac38-f4342317f92b:14210:1870604319939456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783947645.117021:0:14210:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947645.117026:0:14210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947645.117028:0:14210:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783947645.117032:0:14210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1783947645.117180:0:14166:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1783947645.117197:0:14166:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783947645.117211:0:14166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630400/0x20c3e53e78bb2de7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2dee expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.117222:0:14166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630400/0x20c3e53e78bb2de7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2dee expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947645.117262:0:14166:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783947645.117265:0:14166:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b3cbd9ce000 10000000:01000000:2.0:1783947645.117268:0:14166:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b3cbd9ce000 10000000:01000000:2.0:1783947645.117272:0:14166:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783947645.117278:0:14166:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b3cbd9ce000 from 1 10000000:01000000:2.0:1783947645.117281:0:14166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783947645.117306:0:14166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb2df5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.117315:0:14166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb2df5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.117324:0:14166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb2df5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947645.117340:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319939584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783947645.117382:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947645.117437:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8820c180 going to sleep for 11 seconds 00000100:00100000:3.0:1783947645.117496:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319939584 00000100:00100000:3.0:1783947645.117507:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319939584 00000100:00100000:3.0:1783947645.117533:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783947645.117541:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+11:14166:x1870604319939584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947645.117550:0:14178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947645.117561:0:14178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3ca9d1b000/0x20c3e53e78bb2dfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb2df5 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947645.117581:0:14178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3ca9d1b000/0x20c3e53e78bb2dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb2df5 expref: 12 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947645.117607:0:14178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3ca9d1b000/0x20c3e53e78bb2dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2df5 expref: 12 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947645.117615:0:14178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1b000, rc 0) 00000100:00100000:3.0:1783947645.117652:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14166:x1870604319939584:12345-0@lo:101:mount.lustre.0 Request processed in 112us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947645.117658:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783947645.117731:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319939584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947645.117743:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb2df5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2dfc expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.117752:0:14166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb2df5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb2dfc expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947645.117795:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319939712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947645.117818:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947645.117842:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8820c180 going to sleep for 11 seconds 00000100:00100000:3.0:1783947645.118408:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319939712 00000100:00100000:3.0:1783947645.118414:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319939712 00000100:00100000:3.0:1783947645.118464:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783947645.118470:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14166:x1870604319939712:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947645.118711:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14166:x1870604319939712:12345-0@lo:501:mount.lustre.0 Request processed in 239us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947645.118718:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783947645.118813:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319939712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947645.118845:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319939840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947645.118883:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947645.118902:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8820c180 going to sleep for 11 seconds 00000100:00100000:3.0:1783947645.119092:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319939840 00000100:00100000:3.0:1783947645.119097:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319939840 00000100:00100000:3.0:1783947645.119122:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783947645.119128:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14166:x1870604319939840:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783947645.119290:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14166:x1870604319939840:12345-0@lo:503:mount.lustre.0 Request processed in 161us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947645.119297:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783947645.119560:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319939840:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947645.121526:0:14211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9e11f6c7-2161-442e-ac38-f4342317f92b:14211:1870604319939968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947645.121610:0:14211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947645.121655:0:14211:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b85d930c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947645.121718:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319939968 00000100:00100000:2.0:1783947645.121724:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319939968 00000100:00100000:2.0:1783947645.121770:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783947645.121779:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14211:x1870604319939968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947645.122005:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14211:x1870604319939968:12345-0@lo:502:llog_process_th.0 Request processed in 227us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947645.122013:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783947645.122132:0:14211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9e11f6c7-2161-442e-ac38-f4342317f92b:14211:1870604319939968:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1783947645.122189:0:14211:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783947645.122204:0:14211:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8b3b84a88000) 00000020:00000080:1.0:1783947645.122225:0:14211:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1783947645.122363:0:14211:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b3cbd9ce000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783947645.122367:0:14211:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b3cbd9ce000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783947645.122369:0:14211:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b3cbd9ce000 4 00010000:00080000:1.0:1783947645.122393:0:14211:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b3c90d6a800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:1.0:1783947645.123935:0:14211:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1783947645.124040:0:14211:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783947645.124070:0:14211:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783947645.124081:0:14211:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x20c3e53e78bb2e0a 00000100:00080000:1.0:1783947645.124089:0:14211:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783947645.124094:0:14211:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8b3c90d6a800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1783947645.124126:0:14211:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3cb60a0000 x1870604319940096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783947645.124160:0:14211:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783947645.124342:0:14211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9e11f6c7-2161-442e-ac38-f4342317f92b:14211:1870604319940224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947645.124409:0:14211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947645.124459:0:14211:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b85d930c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947645.127138:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319940224 00000100:00100000:2.0:1783947645.127159:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319940224 00000100:00100000:2.0:1783947645.127220:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783947645.127230:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14211:x1870604319940224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947645.127526:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14211:x1870604319940224:12345-0@lo:502:llog_process_th.0 Request processed in 297us (3116us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947645.127534:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783947645.127600:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1870604319940096:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783947645.127638:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947645.130773:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319940096 00000100:00100000:1.0:1783947645.130792:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319940096 00000100:00100000:1.0:1783947645.130834:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947645.130841:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1870604319940096:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783947645.130934:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1870604319940096:12345-0@lo:38:llog_process_th.0 Request processed in 91us (3294us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783947645.130941:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947645.130989:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783947645.130997:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3c90d6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783947645.131001:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783947645.131005:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1870604319940096:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783947645.131058:0:14211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9e11f6c7-2161-442e-ac38-f4342317f92b:14211:1870604319940224:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783947645.131090:0:14211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1783947645.134269:0:14166:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1783947645.134297:0:14166:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783947645.134324:0:14166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb2df5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2dfc expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947645.134337:0:14166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630600/0x20c3e53e78bb2df5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2dfc expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783947645.134385:0:14166:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783947645.134387:0:14166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783947645.134388:0:14166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783947645.134389:0:14166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947645.134390:0:14166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947645.134392:0:14166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947645.134394:0:14166:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783947645.134395:0:14166:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783947645.134397:0:14166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947645.134399:0:14166:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783947645.134402:0:14166:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1783947645.134404:0:14166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783947645.134405:0:14166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783947645.134406:0:14166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783947645.134407:0:14166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947645.134409:0:14166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947645.134410:0:14166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947645.134411:0:14166:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783947645.134412:0:14166:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783947645.134413:0:14166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947645.134414:0:14166:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783947645.134869:0:14166:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783947645.134890:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319940352:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783947645.134969:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947645.135014:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e2b840 going to sleep for 11 seconds 00000100:00100000:1.0:1783947645.135663:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319940352 00000100:00100000:1.0:1783947645.135673:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319940352 00000100:00100000:1.0:1783947645.135719:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783947645.135728:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14166:x1870604319940352:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783947645.135752:0:14177:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783947645.135764:0:14177:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783947645.181203:0:14177:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783947645.181223:0:14177:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1783947645.181477:0:14200:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783947645.181482:0:14200:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783947645.181503:0:14200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b3ca9d1b400/0x20c3e53e78bb2e11 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947645.181521:0:14200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3cbd824a00/0x20c3e53e78bb2de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2dd9 expref: 12 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947645.181530:0:14200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b3ca9d1b400/0x20c3e53e78bb2e11 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947645.181565:0:14200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3cbd824a00/0x20c3e53e78bb2de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb2dd9 expref: 12 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947645.181578:0:14200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b3cbd824a00/0x20c3e53e78bb2de0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb2dd9 expref: 12 pid: 14179 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947645.181603:0:14200:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14200:1870604319940480:0@lo:104: 00000100:00100000:3.0:1783947645.181664:0:14200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947645.181704:0:14200:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e2b540 going to sleep for 11 seconds 00000100:00100000:0.0:1783947645.183190:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319940480 00000100:00100000:0.0:1783947645.183203:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319940480 00000100:00100000:0.0:1783947645.183256:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783947645.183264:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9e11f6c7-2161-442e-ac38-f4342317f92b+3:14200:x1870604319940480:12345-0@lo:104: 00010000:00010000:0.0:1783947645.183290:0:14167:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631600/0x20c3e53e78bb2dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb2de0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947645.183376:0:14167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783947645.183382:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9e11f6c7-2161-442e-ac38-f4342317f92b+3:14200:x1870604319940480:12345-0@lo:104: Request processed in 120us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947645.183389:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947645.183550:0:14200:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14200:1870604319940480:0@lo:104: 00010000:00010000:3.0:1783947645.183572:0:14200:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b3ca9d1b400/0x20c3e53e78bb2e11 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947645.186031:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947645.186045:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631600/0x20c3e53e78bb2dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb2de0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947645.186056:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631600 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:1.0:1783947645.186060:0:14173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631600/0x20c3e53e78bb2dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb2de0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947645.186085:0:14173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631600/0x20c3e53e78bb2dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb2de0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947645.186093:0:14173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631600/0x20c3e53e78bb2dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb2de0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947645.186099:0:14173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947645.186151:0:14173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631600/0x20c3e53e78bb2dd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2de0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947645.186157:0:14173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947645.186176:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631600/0x20c3e53e78bb2dd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2de0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947645.186194:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631600/0x20c3e53e78bb2dd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2de0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947645.186213:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947645.186215:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947645.186216:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947645.186487:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9e11f6c7-2161-442e-ac38-f4342317f92b:3312:1870604319940608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947645.186550:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947645.186671:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319940608 00000100:00100000:2.0:1783947645.186679:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319940608 00010000:00010000:2.0:1783947645.186706:0:14169:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3cbd824a00/0x20c3e53e78bb2de0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb2dd9 expref: 13 pid: 14179 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947645.186742:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947645.186761:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e11f6c7-2161-442e-ac38-f4342317f92b+13:3312:x1870604319940608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947645.186773:0:14169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947645.186778:0:14169:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3cbd824a00/0x20c3e53e78bb2de0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb2dd9 expref: 13 pid: 14179 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.186789:0:14169:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3cbd824a00/0x20c3e53e78bb2de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb2dd9 expref: 13 pid: 14179 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.186801:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cbd824a00/0x20c3e53e78bb2de0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb2dd9 expref: 13 pid: 14179 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.186814:0:14169:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b3ca9d1b400/0x20c3e53e78bb2e11 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.186821:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3ca9d1b400/0x20c3e53e78bb2e11 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783947645.186843:0:14169:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005361290s 00010000:00010000:2.0:1783947645.186847:0:14169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3ca9d1b400/0x20c3e53e78bb2e11 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.186854:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3ca9d1b400/0x20c3e53e78bb2e11 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.186861:0:14169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b3ca9d1b400/0x20c3e53e78bb2e11 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.186867:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b3ca9d1b400/0x20c3e53e78bb2e11 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.186872:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1b400 already unused, calling callback (ffffffffc1552360) 00010000:00010000:2.0:1783947645.186876:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b3ca9d1b400/0x20c3e53e78bb2e11 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.186884:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b3ca9d1b400/0x20c3e53e78bb2e11 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.186904:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b3ca9d1b400/0x20c3e53e78bb2e11 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947645.186913:0:14169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947645.186953:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e11f6c7-2161-442e-ac38-f4342317f92b+12:3312:x1870604319940608:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947645.186961:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947645.187009:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9e11f6c7-2161-442e-ac38-f4342317f92b:3312:1870604319940608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947645.187284:0:14200:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b3ca9d1b400/0x20c3e53e78bb2e11 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947645.187293:0:14200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b3ca9d1b400/0x20c3e53e78bb2e11 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947645.187299:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3ca9d1b400/0x20c3e53e78bb2e11 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947645.189903:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+11:14166:x1870604319940352:12345-0@lo:253:mount.lustre.0 Request processed in 54168us (54925us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947645.189917:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783947645.189995:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14166:1870604319940352:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783947645.190010:0:14166:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783947645.190013:0:14166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783947645.190025:0:14166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783947645.190026:0:14166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783947645.190027:0:14166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947645.190029:0:14166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947645.190030:0:14166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947645.190031:0:14166:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783947645.190032:0:14166:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783947645.190034:0:14166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947645.190035:0:14166:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783947645.190049:0:14166:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783947645.195920:0:14166:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1783947645.196115:0:14166:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783947645.196408:0:14166:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1783947645.197119:0:14166:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783947645.198354:0:14166:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1783947645.198632:0:14166:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1783947645.199621:0:14166:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1783947645.199863:0:14166:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1783947645.200093:0:14166:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1783947645.200318:0:14166:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1783947645.200708:0:14166:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1783947645.200913:0:14166:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1783947645.224355:0:14166:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1783947645.224730:0:14166:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1783947645.224931:0:14223:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1783947645.224935:0:14223:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1783947645.225010:0:14224:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1783947645.225073:0:14224:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1783947645.229825:0:14166:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1783947645.229953:0:14166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783947645.230361:0:14166:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783947645.230368:0:14166:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783947645.230528:0:14166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947645.230869:0:14224:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783947645.230944:0:14224:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783947645.230949:0:14224:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1783947645.232546:0:14166:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783947645.233511:0:14166:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783947645.233559:0:14166:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1783947645.235198:0:14166:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1783947645.241706:0:14166:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1783947645.270481:0:14166:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1783947645.270520:0:14166:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb2868150b988 00100000:10000000:1.0:1783947645.270528:0:14166:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1783947645.271222:0:14166:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783947645.271238:0:14166:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.132@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783947645.271256:0:14166:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783947645.271280:0:14166:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1783947645.882935:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783947646.139500:0:14182:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783947646.139509:0:14182:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8b3cbd9ce000 from 6 10000000:01000000:2.0:1783947646.139514:0:14182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783947646.139576:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2e18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947646.139599:0:14182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2e18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947646.139636:0:14182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2e18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947646.139664:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319940736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947646.140484:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947646.140530:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3caec5dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947646.140648:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319940736 00000100:00100000:2.0:1783947646.140658:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319940736 00000100:00100000:2.0:1783947646.140708:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783947646.140718:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+11:14182:x1870604319940736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947646.140732:0:14178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947646.140758:0:14178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cc0630a00/0x20c3e53e78bb2e1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb2e18 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947646.140781:0:14178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cc0630a00/0x20c3e53e78bb2e1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb2e18 expref: 12 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947646.140792:0:14178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cc0630a00/0x20c3e53e78bb2e1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2e18 expref: 12 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947646.140800:0:14178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630a00, rc 0) 00000100:00100000:2.0:1783947646.140844:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14182:x1870604319940736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947646.140850:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783947646.140972:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319940736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947646.140988:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2e18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2e1f expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947646.140998:0:14182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2e18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb2e1f expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947646.141058:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319940864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783947646.141089:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947646.141118:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e2b540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947646.141757:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319940864 00000100:00100000:1.0:1783947646.141764:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319940864 00000100:00100000:1.0:1783947646.141797:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783947646.141806:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14182:x1870604319940864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783947646.141822:0:14179:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783947646.141836:0:14179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783947646.141839:0:14179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1783947646.142040:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14182:x1870604319940864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 235us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947646.142048:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783947646.142661:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319940864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783947646.142714:0:14182:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783947646.142722:0:14182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2e18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2e1f expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947646.142733:0:14182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2e18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2e1f expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783947646.208278:0:14219:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783947646.910881:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783947647.226569:0:14219:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783947647.929604:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947648.953633:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783947649.638280:0:14467:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783947649.981590:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783947650.619690:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783947650.619697:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783947650.619700:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783947650.619703:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783947650.619705:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783947650.619716:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783947650.619720:0:36:0:(import.c:65:import_set_state_nolock()) ffff8b3c90d6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783947650.619732:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8b3c90d6a800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1783947650.619755:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3cb60a0a80 x1870604319941120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783947650.619806:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9e11f6c7-2161-442e-ac38-f4342317f92b:3313:1870604319940992:0@lo:400:kworker.0 00000100:00100000:1.0:1783947650.619867:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947650.619924:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319940992 00000100:00100000:1.0:1783947650.619930:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319940992 00000100:00100000:1.0:1783947650.619970:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783947650.619979:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+12:3313:x1870604319940992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947650.620029:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+12:3313:x1870604319940992:12345-0@lo:400:kworker.0 Request processed in 51us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947650.620037:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783947650.620085:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9e11f6c7-2161-442e-ac38-f4342317f92b:3313:1870604319940992:0@lo:400:kworker.0 00000100:00100000:3.0:1783947650.622144:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1870604319941120:0@lo:38:kworker.0 00000100:00100000:3.0:1783947650.622217:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947650.622324:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319941120 00000100:00100000:3.0:1783947650.622331:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319941120 00000100:00100000:3.0:1783947650.622366:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947650.622373:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1870604319941120:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783947650.622400:0:14186:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:3.0:1783947650.622454:0:14186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x20c3e53e78bb2e26 00000004:00100000:3.0:1783947650.622469:0:14186:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783947650.622606:0:14186:0:(import.c:65:import_set_state_nolock()) ffff8b3c857b7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947650.622658:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1870604319941120:12345-0@lo:38:kworker.0 Request processed in 283us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947650.622666:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783947650.623045:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b3cb60a0a80 x1870604319941120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783947650.623061:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1783947650.623078:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783947650.623082:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783947650.623085:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3c90d6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783947650.623091:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1870604319941120:0@lo:38:kworker.0 00010000:00010000:1.0:1783947651.004443:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947652.028620:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783947652.849951:0:14617:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe698fcea0 20000000:00000080:1.0:1783947652.849970:0:14617:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b3cb571f400 uarg=0000000000000000 20000000:01000000:1.0:1783947652.850006:0:14617:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1783947652.850011:0:14617:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1783947652.850017:0:14617:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1783947652.853980:0:14618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1783947652.854164:0:14617:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783947652.865050:0:14617:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783947652.865082:0:14617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b3cc0630000/0x20c3e53e78bb2e2d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947652.865128:0:14617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3cbd825200/0x20c3e53e78bb2dee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2de7 expref: 11 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947652.865137:0:14617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b3cc0630000/0x20c3e53e78bb2e2d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947652.865177:0:14617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3cbd825200/0x20c3e53e78bb2dee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb2de7 expref: 11 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947652.865194:0:14617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b3cbd825200/0x20c3e53e78bb2dee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb2de7 expref: 11 pid: 14177 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947652.865209:0:14617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14617:1870604319941248:0@lo:104: 00000100:00100000:2.0:1783947652.865273:0:14617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947652.867246:0:14617:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e42840 going to sleep for 11 seconds 00000100:00100000:1.0:1783947652.867911:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319941248 00000100:00100000:1.0:1783947652.867921:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319941248 00000100:00100000:1.0:1783947652.867965:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947652.867974:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9e11f6c7-2161-442e-ac38-f4342317f92b+3:14617:x1870604319941248:12345-0@lo:104: 00010000:00010000:1.0:1783947652.868007:0:14168:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630400/0x20c3e53e78bb2de7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb2dee expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947652.868106:0:14168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947652.868113:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9e11f6c7-2161-442e-ac38-f4342317f92b+3:14617:x1870604319941248:12345-0@lo:104: Request processed in 140us (2840us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947652.868120:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1783947652.868223:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947652.868231:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630400/0x20c3e53e78bb2de7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb2dee expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947652.868238:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630400 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:3.0:1783947652.868242:0:14173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630400/0x20c3e53e78bb2de7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb2dee expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947652.868250:0:14173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630400/0x20c3e53e78bb2de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb2dee expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947652.868257:0:14173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630400/0x20c3e53e78bb2de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb2dee expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947652.868262:0:14173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783947652.868313:0:14173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630400/0x20c3e53e78bb2de7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2dee expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947652.868319:0:14173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947652.868338:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630400/0x20c3e53e78bb2de7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2dee expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947652.868345:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630400/0x20c3e53e78bb2de7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2dee expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947652.868361:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947652.868369:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947652.868371:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947652.868388:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9e11f6c7-2161-442e-ac38-f4342317f92b:3314:1870604319941376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947652.868464:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947652.868512:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319941376 00000100:00100000:3.0:1783947652.868516:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319941376 00010000:00010000:3.0:1783947652.868547:0:14169:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3cbd825200/0x20c3e53e78bb2dee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb2de7 expref: 12 pid: 14177 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947652.868569:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947652.868575:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e11f6c7-2161-442e-ac38-f4342317f92b+12:3314:x1870604319941376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783947652.868586:0:14169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947652.868591:0:14169:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3cbd825200/0x20c3e53e78bb2dee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb2de7 expref: 12 pid: 14177 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947652.868839:0:14169:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3cbd825200/0x20c3e53e78bb2dee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb2de7 expref: 12 pid: 14177 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947652.868859:0:14169:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b3cc0630000/0x20c3e53e78bb2e2d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947652.868867:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cc0630000/0x20c3e53e78bb2e2d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947652.868882:0:14169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3cc0630000/0x20c3e53e78bb2e2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947652.868889:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3cc0630000/0x20c3e53e78bb2e2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947652.868895:0:14169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b3cc0630000/0x20c3e53e78bb2e2d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947652.868907:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b3cc0630000/0x20c3e53e78bb2e2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947652.868913:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630000 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947652.868917:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b3cc0630000/0x20c3e53e78bb2e2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947652.868925:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b3cc0630000/0x20c3e53e78bb2e2d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947652.868934:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b3cc0630000/0x20c3e53e78bb2e2d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947652.868943:0:14169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947652.868977:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e11f6c7-2161-442e-ac38-f4342317f92b+12:3314:x1870604319941376:12345-0@lo:103:ldlm_bl.0 Request processed in 402us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947652.868984:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947652.869020:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9e11f6c7-2161-442e-ac38-f4342317f92b:3314:1870604319941376:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947652.869304:0:14617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cbd825200/0x20c3e53e78bb2dee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb2de7 expref: 11 pid: 14177 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947652.869318:0:14617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14617:1870604319941248:0@lo:104: 00010000:00010000:2.0:1783947652.869335:0:14617:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b3cc0630000/0x20c3e53e78bb2e2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947652.869344:0:14617:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b3cc0630000/0x20c3e53e78bb2e2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947652.869350:0:14617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b3cc0630000/0x20c3e53e78bb2e2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947652.869356:0:14617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cc0630000/0x20c3e53e78bb2e2d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.054305:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783947654.010683:0:14182:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783947654.010691:0:14182:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3cbd9ce000 from 10 10000000:01000000:1.0:1783947654.010697:0:14182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947654.010739:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825a00/0x20c3e53e78bb2e34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947654.010751:0:14182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825a00/0x20c3e53e78bb2e34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947654.010762:0:14182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825a00/0x20c3e53e78bb2e34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947654.010789:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319941504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947654.010864:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947654.010913:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783947654.011069:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319941504 00000100:00100000:2.0:1783947654.011076:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319941504 00000100:00100000:2.0:1783947654.011122:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947654.011132:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+11:14182:x1870604319941504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947654.011146:0:14177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947654.011160:0:14177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cc0630c00/0x20c3e53e78bb2e3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb2e34 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947654.011183:0:14177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cc0630c00/0x20c3e53e78bb2e3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb2e34 expref: 12 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947654.011192:0:14177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cc0630c00/0x20c3e53e78bb2e3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2e34 expref: 12 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947654.011201:0:14177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630c00, rc 0) 00000100:00100000:2.0:1783947654.011240:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14182:x1870604319941504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947654.011247:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783947654.011690:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319941504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947654.011707:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825a00/0x20c3e53e78bb2e34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2e3b expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947654.011715:0:14182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825a00/0x20c3e53e78bb2e34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb2e3b expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947654.011782:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319941632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947654.011826:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947654.011856:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947654.012020:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319941632 00000100:00100000:0.0:1783947654.012026:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319941632 00000100:00100000:0.0:1783947654.012058:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783947654.012065:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14182:x1870604319941632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947654.012357:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14182:x1870604319941632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947654.012364:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783947654.012708:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319941632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947654.012756:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319941760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947654.012795:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947654.012835:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947654.012929:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319941760 00000100:00100000:0.0:1783947654.012934:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319941760 00000100:00100000:0.0:1783947654.012969:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783947654.012977:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14182:x1870604319941760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947654.013138:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14182:x1870604319941760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947654.013146:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783947654.013220:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319941760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783947654.014036:0:14662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1783947654.014300:0:14182:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1783947654.014324:0:14182:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783947654.014333:0:14182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825a00/0x20c3e53e78bb2e34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2e3b expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947654.014353:0:14182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825a00/0x20c3e53e78bb2e34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2e3b expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947654.073860:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947655.098034:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947655.739199:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947645/real 1783947645] req@ffff8b3cbd4bad80 x1870604319938432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947655 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947655.739230:0:3310:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b3cbd4bad80 x1870604319938432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947655 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947655.739241:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947645/real 1783947645] req@ffff8b3cbd4b8e00 x1870604319938304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947655 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947655.739278:0:3310:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b3cbd4b8e00 x1870604319938304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947655 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783947655.739298:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3c8579e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783947655.739323:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783947655.739327:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319938432:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783947655.739333:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3c9e6c6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783947655.739339:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783947655.739341:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319938304:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1783947655.740193:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947655.740199:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783947655.740202:0:36:0:(import.c:65:import_set_state_nolock()) ffff8b3c9e6c6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783947655.740210:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:3.0:1783947655.740215:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783947655.740222:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8b3c9e6c6000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1783947655.740244:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3b850d2300 x1870604319942016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947655.740279:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947655.740283:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783947655.740285:0:36:0:(import.c:65:import_set_state_nolock()) ffff8b3c8579e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783947655.740288:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:3.0:1783947655.740291:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783947655.740295:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8b3c8579e000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1783947655.740310:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3b850d1c00 x1870604319942144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783947655.740345:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9e11f6c7-2161-442e-ac38-f4342317f92b:3311:1870604319941888:0@lo:400:kworker.0 00000100:00100000:2.0:1783947655.740347:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319942016:0@lo:8:kworker.0 00000100:00100000:3.0:1783947655.740646:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947655.740695:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947655.740702:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319942272:0@lo:400:kworker.0 00000100:00100000:3.0:1783947655.740788:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947655.741082:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319941888 00000100:00100000:3.0:1783947655.741089:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319941888 00000100:00100000:3.0:1783947655.741133:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783947655.741142:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+12:3311:x1870604319941888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947655.741191:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+12:3311:x1870604319941888:12345-0@lo:400:kworker.0 Request processed in 50us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947655.741199:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783947655.741241:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319942272 00000100:00100000:3.0:1783947655.741245:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319942272 00000100:00100000:3.0:1783947655.741272:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947655.741279:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319942272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947655.741318:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319942272:12345-0@lo:400:kworker.0 Request processed in 39us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947655.741332:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783947655.741373:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b3b850d0380 x1870604319942272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947655.741387:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319942272:0@lo:400:kworker.0 00000100:00100000:3.0:1783947655.741400:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9e11f6c7-2161-442e-ac38-f4342317f92b:3311:1870604319941888:0@lo:400:kworker.0 00000400:00000100:2.0:1783947655.741948:0:3310:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604319942016 offset 0 length 520: 4 00000100:00100000:2.0:1783947655.741981:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319942144:0@lo:8:kworker.0 00000400:00000100:2.0:1783947655.742007:0:3310:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604319942144 offset 0 length 520: 4 00010000:00010000:3.0:1783947656.121730:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947657.145614:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783947657.467184:0:14219:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1783947657.622346:0:14818:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783947657.622350:0:14818:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1783947657.622492:0:14818:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8b3c88436800 00000020:01000004:0.0:1783947657.622524:0:14818:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1783947657.622536:0:14818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1783947657.622549:0:14818:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8b3cbda4b380) 00000020:00000080:0.0:1783947657.622564:0:14818:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783947657.648833:0:14818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1783947657.649056:0:14818:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1783947657.651137:0:14818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1783947657.652829:0:14818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1783947657.653161:0:14818:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1783947657.653963:0:14818:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 503: rc = 0 00100000:10000000:0.0:1783947657.654107:0:14818:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 503: rc = 0 00100000:10000000:0.0:1783947657.654205:0:14818:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 503: rc = 0 00100000:10000000:0.0:1783947657.654713:0:14818:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 285: rc = 0 00100000:10000000:0.0:1783947657.655236:0:14818:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 285: rc = 0 00100000:10000000:0.0:1783947657.655529:0:14818:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 285: rc = 0 00100000:10000000:0.0:1783947657.659572:0:14818:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 285: rc = 0 00100000:10000000:0.0:1783947657.659852:0:14818:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 285: rc = 0 00100000:10000000:0.0:1783947657.660125:0:14818:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 285: rc = 0 00000020:00000080:0.0:1783947657.660761:0:14818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1783947657.660777:0:14818:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783947657.660788:0:14818:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x20c3e53e78bb2e49 00000020:01000004:0.0:1783947657.660796:0:14818:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1783947657.660815:0:14818:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.132@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783947657.660819:0:14818:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783947657.660824:0:14818:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1783947657.660829:0:14818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1783947657.660839:0:14818:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8b3cbda4cd40) 00000020:00000080:0.0:1783947657.660849:0:14818:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1783947657.662147:0:14818:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783947657.662334:0:14818:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1783947657.662340:0:14818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1783947657.663551:0:14818:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1783947657.663559:0:14818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1783947657.664957:0:14818:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1783947657.664967:0:14818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1783947657.667400:0:14818:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783947657.667621:0:14818:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1783947657.667629:0:14818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1783947657.668544:0:14818:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1783947657.668552:0:14818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1783947657.680688:0:14818:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783947657.680912:0:14818:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783947657.680918:0:14818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1783947657.685259:0:14818:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783947657.685274:0:14818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1783947657.686786:0:14818:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783947657.686869:0:14818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1783947657.689390:0:14818:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783947657.689659:0:14818:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1783947657.689665:0:14818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1783947657.691620:0:14818:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1783947657.691633:0:14818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1783947657.721398:0:14818:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783947657.721698:0:14818:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1783947657.721705:0:14818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1783947657.722798:0:14818:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1783947657.722806:0:14818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1783947657.724777:0:14818:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1783947657.724810:0:14818:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1783947657.724816:0:14818:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.132@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783947657.742771:0:14818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.132@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783947657.742819:0:14818:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.132@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1783947657.742823:0:14818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783947657.742825:0:14818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783947657.742826:0:14818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947657.742828:0:14818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947657.742829:0:14818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947657.742830:0:14818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947657.742831:0:14818:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947657.742833:0:14818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947657.742834:0:14818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783947657.742838:0:14818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1783947657.742840:0:14818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783947657.742841:0:14818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783947657.742842:0:14818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947657.742848:0:14818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947657.742849:0:14818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947657.742850:0:14818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947657.742851:0:14818:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947657.742852:0:14818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947657.742853:0:14818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783947657.742880:0:14818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783947657.742899:0:14818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319942400:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783947657.742964:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947657.743512:0:14818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb673fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947657.744592:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319942400 00000100:00100000:1.0:1783947657.744614:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319942400 00000100:00100000:0.0:1783947657.744956:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783947657.744968:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14818:x1870604319942400:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783947657.745021:0:14178:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783947657.745025:0:14178:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1783947657.745029:0:14178:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1783947657.752685:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14818:x1870604319942400:12345-0@lo:253:mount.lustre.0 Request processed in 7711us (9712us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947657.752698:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783947657.752797:0:14818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319942400:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783947657.752813:0:14818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783947657.752817:0:14818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783947657.752819:0:14818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783947657.752820:0:14818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947657.752821:0:14818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947657.752822:0:14818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947657.752824:0:14818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947657.752825:0:14818:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947657.752827:0:14818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947657.752829:0:14818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783947657.752849:0:14818:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b3c88436800 from lustre-OST0000 10000000:01000000:2.0:1783947657.752876:0:14818:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783947657.752879:0:14818:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783947657.752886:0:14818:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8b3c857619c0 local copy 00010000:00010000:2.0:1783947657.752896:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb2d3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2d46 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947657.753835:0:14818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319942528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947657.753894:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947657.753941:0:14818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb673fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947657.754001:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319942528 00000100:00100000:0.0:1783947657.754008:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319942528 00000100:00100000:0.0:1783947657.754042:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783947657.754048:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14818:x1870604319942528:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947657.754216:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14818:x1870604319942528:12345-0@lo:501:mount.lustre.0 Request processed in 168us (322us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783947657.754222:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783947657.754251:0:14818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319942528:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783947657.754268:0:14818:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783947657.754462:0:14818:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783947657.754471:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb2d3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2d46 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947657.754481:0:14818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb2d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2d46 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947657.754521:0:14818:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b3c88436800 10000000:01000000:2.0:1783947657.754527:0:14818:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783947657.754532:0:14818:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8b3c857619c0 10000000:01000000:2.0:1783947657.754535:0:14818:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1783947657.754539:0:14818:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8b3c857619c0 from 1 10000000:01000000:2.0:1783947657.754542:0:14818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783947657.754569:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631200/0x20c3e53e78bb2e57 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947657.754577:0:14818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631200/0x20c3e53e78bb2e57 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947657.754587:0:14818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631200/0x20c3e53e78bb2e57 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947657.754602:0:14818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319942656:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783947657.754633:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947657.754953:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319942656 00000100:00100000:0.0:1783947657.754957:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319942656 00000100:00100000:2.0:1783947657.754968:0:14818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb673fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947657.755109:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783947657.755117:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+12:14818:x1870604319942656:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947657.755128:0:14178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947657.755143:0:14178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c85670e00/0x20c3e53e78bb2e5e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb2e57 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.755165:0:14178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c85670e00/0x20c3e53e78bb2e5e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb2e57 expref: 13 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.755175:0:14178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c85670e00/0x20c3e53e78bb2e5e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2e57 expref: 13 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.755182:0:14178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670e00, rc 0) 00000100:00100000:0.0:1783947657.755212:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+13:14818:x1870604319942656:12345-0@lo:101:mount.lustre.0 Request processed in 97us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947657.755217:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783947657.755378:0:14818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319942656:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947657.755393:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631200/0x20c3e53e78bb2e57 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2e5e expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947657.755403:0:14818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631200/0x20c3e53e78bb2e57 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb2e5e expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947657.755455:0:14818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783947657.755468:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631200/0x20c3e53e78bb2e57 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2e5e expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947657.755476:0:14818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631200/0x20c3e53e78bb2e57 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2e5e expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947657.755483:0:14818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783947657.755488:0:14818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783947657.755493:0:14818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1783947657.755496:0:14818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783947657.755526:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631e00/0x20c3e53e78bb2e65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947657.755534:0:14818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631e00/0x20c3e53e78bb2e65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947657.755541:0:14818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631e00/0x20c3e53e78bb2e65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947657.755556:0:14818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319942784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783947657.755585:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947657.755611:0:14818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb673fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947657.755618:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319942784 00000100:00100000:0.0:1783947657.755622:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319942784 00000100:00100000:0.0:1783947657.755648:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783947657.755653:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+13:14818:x1870604319942784:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947657.755658:0:14179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947657.755664:0:14179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c85671c00/0x20c3e53e78bb2e6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb2e65 expref: -99 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.755674:0:14179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c85671c00/0x20c3e53e78bb2e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb2e65 expref: 14 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.755680:0:14179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c85671c00/0x20c3e53e78bb2e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2e65 expref: 14 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.755693:0:14179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671c00, rc 0) 00000100:00100000:0.0:1783947657.755719:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+14:14818:x1870604319942784:12345-0@lo:101:mount.lustre.0 Request processed in 66us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947657.755723:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783947657.756196:0:14818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319942784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947657.756206:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631e00/0x20c3e53e78bb2e65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2e6c expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947657.756211:0:14818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631e00/0x20c3e53e78bb2e65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb2e6c expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947657.756890:0:14818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1783947657.757757:0:14818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947657.757989:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1783947657.758031:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1783947657.758062:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1783947657.758101:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1783947657.758129:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1783947657.758154:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1783947657.758219:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1783947657.758228:0:14818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1783947657.758302:0:14818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319942912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947657.758364:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947657.758409:0:14818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb673f780 going to sleep for 11 seconds 00000100:00100000:0.0:1783947657.758583:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319942912 00000100:00100000:0.0:1783947657.758591:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319942912 00000100:00100000:0.0:1783947657.758638:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783947657.758645:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+14:14818:x1870604319942912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947657.758880:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+14:14818:x1870604319942912:12345-0@lo:501:mount.lustre.0 Request processed in 235us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947657.758886:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783947657.758910:0:14818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319942912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947657.758938:0:14818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319943040:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947657.758968:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947657.758990:0:14818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb673f780 going to sleep for 11 seconds 00000100:00100000:3.0:1783947657.759016:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319943040 00000100:00100000:3.0:1783947657.759021:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319943040 00000100:00100000:3.0:1783947657.759046:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783947657.759051:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+14:14818:x1870604319943040:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783947657.759315:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+14:14818:x1870604319943040:12345-0@lo:503:mount.lustre.0 Request processed in 262us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947657.759322:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783947657.759339:0:14818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319943040:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783947657.759784:0:14818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783947657.759825:0:14818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319943168:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947657.759859:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947657.759887:0:14818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb673f780 going to sleep for 11 seconds 00000100:00100000:0.0:1783947657.759909:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319943168 00000100:00100000:0.0:1783947657.759915:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319943168 00000100:00100000:0.0:1783947657.759955:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783947657.759962:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+14:14818:x1870604319943168:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947657.760160:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+14:14818:x1870604319943168:12345-0@lo:502:mount.lustre.0 Request processed in 197us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947657.760167:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783947657.760337:0:14818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319943168:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947657.760610:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1783947657.760661:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1783947657.760706:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1783947657.760759:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1783947657.760802:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1783947657.760841:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1783947657.760883:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1783947657.760906:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1783947657.760923:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1783947657.760947:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1783947657.760965:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1783947657.760993:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1783947657.761084:0:14818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319943296:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947657.761130:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947657.761166:0:14818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb673f780 going to sleep for 11 seconds 00000100:00100000:3.0:1783947657.761250:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319943296 00000100:00100000:3.0:1783947657.761257:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319943296 00000100:00100000:0.0:1783947657.761329:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783947657.761340:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+14:14818:x1870604319943296:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947657.761551:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+14:14818:x1870604319943296:12345-0@lo:502:mount.lustre.0 Request processed in 214us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947657.761559:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783947657.762290:0:14818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319943296:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947657.762404:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1783947657.762451:0:14818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1783947657.763359:0:14832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783947657.763366:0:14832:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1783947657.763373:0:14832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947657.763375:0:14832:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1783947657.763380:0:14832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783947657.763395:0:14832:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8b3cbd3b8000) 00000020:00000080:2.0:1783947657.763448:0:14832:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783947657.763455:0:14832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783947657.763539:0:14832:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b3c88436800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1783947657.763547:0:14832:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783947657.763554:0:14832:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x20c3e53e78bb2e7a 00010000:00010000:2.0:1783947657.766722:0:14832:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1783947657.767088:0:14832:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1783947657.768561:0:14832:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1783947657.774688:0:14832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1783947657.774726:0:14832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947657.774733:0:14832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947657.774734:0:14832:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1783947657.774740:0:14832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783947657.774743:0:14832:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1783947657.774744:0:14832:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783947657.774746:0:14832:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783947657.774747:0:14832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783947657.774749:0:14832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947657.774750:0:14832:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783947657.774753:0:14832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947657.774756:0:14832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947657.774757:0:14832:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783947657.774760:0:14832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783947657.774762:0:14832:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783947657.774764:0:14832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947657.774766:0:14832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947657.774768:0:14832:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783947657.774770:0:14832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947657.774784:0:14832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947657.774785:0:14832:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783947657.774789:0:14832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783947657.774857:0:14832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947657.774861:0:14832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947657.774862:0:14832:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783947657.774866:0:14832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1783947657.775491:0:14818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1783947657.775552:0:14818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783947657.775572:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631e00/0x20c3e53e78bb2e65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2e6c expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.775584:0:14818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631e00/0x20c3e53e78bb2e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2e6c expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947657.775594:0:14818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3c88436800 from 1 10000000:01000000:0.0:1783947657.775598:0:14818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783947657.775633:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85671a00/0x20c3e53e78bb2e81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.775641:0:14818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3c85671a00/0x20c3e53e78bb2e81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.775653:0:14818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3c85671a00/0x20c3e53e78bb2e81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947657.775678:0:14818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319943424:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783947657.775742:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947657.775790:0:14818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85d33600 going to sleep for 11 seconds 00000100:00100000:1.0:1783947657.776919:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319943424 00000100:00100000:1.0:1783947657.776931:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319943424 00000100:00100000:1.0:1783947657.776984:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783947657.776994:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+14:14818:x1870604319943424:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947657.777008:0:14179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947657.777023:0:14179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cbd825600/0x20c3e53e78bb2e88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb2e81 expref: -99 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947657.777057:0:14179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cbd825600/0x20c3e53e78bb2e88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb2e81 expref: 15 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947657.777068:0:14179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cbd825600/0x20c3e53e78bb2e88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2e81 expref: 15 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947657.777078:0:14179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cbd825600, rc 0) 00000100:00100000:1.0:1783947657.777216:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+15:14818:x1870604319943424:12345-0@lo:101:mount.lustre.0 Request processed in 223us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947657.777224:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783947657.777599:0:14818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319943424:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947657.777616:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3c85671a00/0x20c3e53e78bb2e81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2e88 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947657.777625:0:14818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3c85671a00/0x20c3e53e78bb2e81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb2e88 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947657.783475:0:14818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1783947657.784500:0:14818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947657.787973:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1783947657.788059:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1783947657.788141:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1783947657.788150:0:14818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1783947657.788255:0:14818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319943552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947657.788319:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947657.788367:0:14818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c91dd7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947657.788454:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319943552 00000100:00100000:3.0:1783947657.788472:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319943552 00000100:00100000:3.0:1783947657.788527:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783947657.788538:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+15:14818:x1870604319943552:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947657.788950:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+15:14818:x1870604319943552:12345-0@lo:501:mount.lustre.0 Request processed in 412us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947657.788958:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783947657.789049:0:14818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319943552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947657.789094:0:14818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319943680:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783947657.789142:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947657.789175:0:14818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85d33600 going to sleep for 11 seconds 00000100:00100000:3.0:1783947657.789229:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319943680 00000100:00100000:3.0:1783947657.789235:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319943680 00000100:00100000:3.0:1783947657.790165:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783947657.790177:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+15:14818:x1870604319943680:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783947657.790991:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+15:14818:x1870604319943680:12345-0@lo:503:mount.lustre.0 Request processed in 814us (1845us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947657.791001:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783947657.794415:0:14818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319943680:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783947657.795058:0:14818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783947657.795142:0:14818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319943808:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947657.795222:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947657.795270:0:14818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c91dd76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947657.795344:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319943808 00000100:00100000:3.0:1783947657.795363:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319943808 00000100:00100000:3.0:1783947657.795414:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783947657.795443:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+15:14818:x1870604319943808:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947657.795665:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+15:14818:x1870604319943808:12345-0@lo:502:mount.lustre.0 Request processed in 223us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947657.795673:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783947657.799998:0:14818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319943808:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947657.800327:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1783947657.800403:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1783947657.800477:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1783947657.800633:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1783947657.800700:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1783947657.800833:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1783947657.800892:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1783947657.800935:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1783947657.800981:0:14818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319943936:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947657.801066:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947657.801108:0:14818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3ca03c4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783947657.803656:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319943936 00000100:00100000:2.0:1783947657.803669:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319943936 00000100:00100000:2.0:1783947657.803724:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783947657.803734:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+15:14818:x1870604319943936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947657.804017:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+15:14818:x1870604319943936:12345-0@lo:502:mount.lustre.0 Request processed in 284us (2950us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947657.804026:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783947657.804457:0:14818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319943936:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783947657.804633:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1783947657.804648:0:14818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1783947657.821705:0:14836:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947657.821718:0:14836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947657.821721:0:14836:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783947657.821727:0:14836:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b3c88436800 00000020:00000080:3.0:1783947657.821729:0:14836:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783947657.821736:0:14836:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947657.821738:0:14836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947657.821740:0:14836:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783947657.821742:0:14836:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947657.821744:0:14836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947657.821746:0:14836:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783947657.821749:0:14836:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b3c88436800 00000020:00000080:3.0:1783947657.821750:0:14836:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783947657.821920:0:14836:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947657.821924:0:14836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947657.821926:0:14836:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783947657.821928:0:14836:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947657.821931:0:14836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947657.821932:0:14836:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783947657.821935:0:14836:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b3c88436800 00000020:00000080:3.0:1783947657.821938:0:14836:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783947657.827984:0:14836:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947657.827998:0:14836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947657.828000:0:14836:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783947657.828005:0:14836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1783947657.829460:0:14818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1783947657.829537:0:14818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783947657.829567:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85671a00/0x20c3e53e78bb2e81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2e88 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.829595:0:14818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c85671a00/0x20c3e53e78bb2e81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2e88 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947657.829651:0:14818:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783947657.829654:0:14818:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b3c88436800 10000000:01000000:0.0:1783947657.829658:0:14818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b3c88436800 10000000:01000000:0.0:1783947657.829662:0:14818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783947657.829668:0:14818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b3c88436800 from 1 10000000:01000000:0.0:1783947657.829670:0:14818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783947657.829703:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85670000/0x20c3e53e78bb2e8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.829710:0:14818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3c85670000/0x20c3e53e78bb2e8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.829719:0:14818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3c85670000/0x20c3e53e78bb2e8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947657.829743:0:14818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319944064:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783947657.830595:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947657.830652:0:14818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c83188840 going to sleep for 11 seconds 00000100:00100000:1.0:1783947657.830661:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319944064 00000100:00100000:1.0:1783947657.830670:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319944064 00000100:00100000:1.0:1783947657.830732:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783947657.830742:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+15:14818:x1870604319944064:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947657.830757:0:14179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947657.830771:0:14179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cbd824200/0x20c3e53e78bb2e96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb2e8f expref: -99 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947657.830798:0:14179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cbd824200/0x20c3e53e78bb2e96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb2e8f expref: 16 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947657.830811:0:14179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cbd824200/0x20c3e53e78bb2e96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2e8f expref: 16 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947657.830819:0:14179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cbd824200, rc 0) 00000100:00100000:1.0:1783947657.830891:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+16:14818:x1870604319944064:12345-0@lo:101:mount.lustre.0 Request processed in 151us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947657.830899:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783947657.831896:0:14818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319944064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947657.831915:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3c85670000/0x20c3e53e78bb2e8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2e96 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.831925:0:14818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3c85670000/0x20c3e53e78bb2e8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb2e96 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783947657.836643:0:14818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1783947657.842620:0:14818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947657.843042:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1783947657.843097:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1783947657.843131:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1783947657.843177:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1783947657.843216:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1783947657.846581:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1783947657.846678:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1783947657.846736:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1783947657.846835:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1783947657.846892:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1783947657.846943:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1783947657.846993:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1783947657.847041:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1783947657.847079:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1783947657.847129:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1783947657.847183:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1783947657.847216:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1783947657.849049:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1783947657.849147:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1783947657.849185:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1783947657.849253:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1783947657.849318:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1783947657.849879:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1783947657.849957:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1783947657.850004:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1783947657.850044:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1783947657.850097:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1783947657.850136:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1783947657.850251:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1783947657.850269:0:14818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1783947657.850684:0:14818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319944192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947657.850747:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947657.851009:0:14818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c83188840 going to sleep for 11 seconds 00000100:00100000:3.0:1783947657.851184:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319944192 00000100:00100000:3.0:1783947657.851192:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319944192 00000100:00100000:3.0:1783947657.851237:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783947657.851260:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+16:14818:x1870604319944192:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947657.851554:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+16:14818:x1870604319944192:12345-0@lo:501:mount.lustre.0 Request processed in 295us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947657.851562:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783947657.851607:0:14818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319944192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947657.851639:0:14818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319944320:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783947657.851674:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947657.851690:0:14818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c82f67480 going to sleep for 11 seconds 00000100:00100000:0.0:1783947657.851953:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319944320 00000100:00100000:0.0:1783947657.851957:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319944320 00000100:00100000:0.0:1783947657.851990:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783947657.851996:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+16:14818:x1870604319944320:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783947657.852147:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+16:14818:x1870604319944320:12345-0@lo:503:mount.lustre.0 Request processed in 151us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947657.852155:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783947657.852474:0:14818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319944320:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783947657.853903:0:14818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783947657.853991:0:14818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319944448:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947657.854062:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947657.854093:0:14818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c82f67480 going to sleep for 11 seconds 00000100:00100000:0.0:1783947657.855125:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319944448 00000100:00100000:0.0:1783947657.855134:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319944448 00000100:00100000:0.0:1783947657.855184:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783947657.855192:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+16:14818:x1870604319944448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947657.855657:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+16:14818:x1870604319944448:12345-0@lo:502:mount.lustre.0 Request processed in 464us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947657.855665:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783947657.855842:0:14818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319944448:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783947657.856211:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1783947657.856461:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1783947657.856512:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1783947657.856571:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1783947657.856611:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1783947657.856664:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1783947657.856717:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1783947657.856897:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1783947657.856951:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1783947657.856990:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1783947657.857025:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1783947657.863608:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1783947657.863663:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1783947657.863720:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1783947657.863777:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1783947657.863811:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1783947657.863846:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1783947657.863894:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1783947657.863932:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1783947657.863968:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1783947657.864016:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1783947657.864055:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1783947657.864090:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1783947657.864159:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1783947657.864195:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1783947657.864228:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1783947657.864276:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1783947657.864314:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1783947657.864348:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1783947657.864398:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1783947657.864484:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1783947657.864552:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1783947657.864869:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1783947657.864933:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1783947657.864973:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1783947657.865021:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1783947657.865059:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1783947657.865109:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1783947657.865158:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1783947657.865197:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1783947657.865244:0:14818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319944576:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783947657.865322:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947657.865354:0:14818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672540 going to sleep for 11 seconds 00000100:00100000:3.0:1783947657.865990:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319944576 00000100:00100000:3.0:1783947657.865998:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319944576 00000100:00100000:3.0:1783947657.866594:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783947657.866607:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+16:14818:x1870604319944576:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947657.867578:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+16:14818:x1870604319944576:12345-0@lo:502:mount.lustre.0 Request processed in 972us (2252us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947657.867598:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783947657.869893:0:14818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319944576:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783947657.870449:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1783947657.870468:0:14818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1783947657.872918:0:14841:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783947657.872935:0:14841:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8b3c85764d40) 00000020:00000080:3.0:1783947657.872957:0:14841:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1783947657.873130:0:14841:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b3c88436800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783947657.873135:0:14841:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b3c88436800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783947657.873137:0:14841:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b3c88436800 3 00010000:00080000:3.0:1783947657.873168:0:14841:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b3c82bea800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.132@tcp at head 00010000:00010000:3.0:1783947657.878471:0:14841:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1783947657.878614:0:14841:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783947657.878653:0:14841:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783947657.878664:0:14841:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x20c3e53e78bb2ea4 00000100:00080000:3.0:1783947657.878676:0:14841:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783947657.878682:0:14841:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b3c82bea800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1783947657.878717:0:14841:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3b850d1880 x1870604319944704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947657.878743:0:14841:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783947657.878848:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947657.878853:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947657.878856:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947657.878860:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783947657.879049:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319944832:0@lo:400:kworker.0 00000100:00100000:1.0:1783947657.879113:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947657.879159:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319944832 00000100:00100000:1.0:1783947657.879166:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319944832 00000100:00100000:1.0:1783947657.879206:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947657.879215:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319944832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947657.879274:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319944832:12345-0@lo:400:kworker.0 Request processed in 59us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947657.879281:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783947657.879360:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b3cbd4b9f80 x1870604319944832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947657.879375:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319944832:0@lo:400:kworker.0 00000100:00100000:2.0:1783947657.880044:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1870604319944704:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783947657.880082:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947657.880140:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319944704 00000100:00100000:2.0:1783947657.880145:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319944704 00000100:00100000:2.0:1783947657.880172:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783947657.880177:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1870604319944704:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783947657.880199:0:14186:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:2.0:1783947657.880239:0:14186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x20c3e53e78bb2eab 00000004:00100000:2.0:1783947657.880254:0:14186:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783947657.880284:0:14186:0:(import.c:65:import_set_state_nolock()) ffff8b3c9e6de000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947657.880324:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1870604319944704:12345-0@lo:38:llog_process_th.0 Request processed in 145us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947657.880331:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783947657.880361:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b3b850d1880 x1870604319944704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947657.880370:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783947657.880377:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1783947657.880383:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783947657.880387:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783947657.880389:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3c82bea800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783947657.880394:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1870604319944704:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1783947657.881320:0:14841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1783947657.881624:0:14818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1783947657.881656:0:14818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783947657.881678:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85670000/0x20c3e53e78bb2e8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2e96 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.881690:0:14818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c85670000/0x20c3e53e78bb2e8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2e96 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783947657.881738:0:14818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783947657.881740:0:14818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783947657.881741:0:14818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947657.881743:0:14818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947657.881744:0:14818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947657.881745:0:14818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947657.881747:0:14818:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783947657.881749:0:14818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947657.881750:0:14818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783947657.881764:0:14818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1783947657.881767:0:14818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783947657.881769:0:14818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783947657.881770:0:14818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947657.881771:0:14818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947657.881772:0:14818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947657.881773:0:14818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947657.881774:0:14818:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783947657.881775:0:14818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947657.881777:0:14818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783947657.881796:0:14818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783947657.881811:0:14818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319944960:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783947657.881858:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947657.881893:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319944960 00000100:00100000:0.0:1783947657.881899:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319944960 00000100:00100000:0.0:1783947657.881929:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783947657.881937:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+16:14818:x1870604319944960:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783947657.881961:0:14179:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783947657.881975:0:14179:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1783947657.882306:0:14818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672540 going to sleep for 11 seconds 20000000:01000000:1.0:1783947657.937825:0:14179:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783947657.937846:0:14179:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783947657.937866:0:14200:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783947657.937871:0:14200:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783947657.937891:0:14200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb2eb2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.937910:0:14200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3cc0630a00/0x20c3e53e78bb2e1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2e18 expref: 16 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.937918:0:14200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb2eb2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.937960:0:14200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3cc0630a00/0x20c3e53e78bb2e1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb2e18 expref: 16 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.937974:0:14200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b3cc0630a00/0x20c3e53e78bb2e1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb2e18 expref: 16 pid: 14178 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947657.937988:0:14200:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4ba300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14200:1870604319945088:0@lo:104: 00000100:00100000:0.0:1783947657.938048:0:14200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947657.938102:0:14200:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3ca03e7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947657.938151:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319945088 00000100:00100000:1.0:1783947657.938158:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319945088 00000100:00100000:1.0:1783947657.938202:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783947657.938211:0:14167:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1783947657.938212:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9e11f6c7-2161-442e-ac38-f4342317f92b+3:14200:x1870604319945088:12345-0@lo:104: 00000100:00100000:2.0:1783947657.938217:0:14167:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1783947657.938224:0:14168:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2e18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb2e1f expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947657.938295:0:14168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947657.938302:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9e11f6c7-2161-442e-ac38-f4342317f92b+3:14200:x1870604319945088:12345-0@lo:104: Request processed in 92us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947657.938309:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783947657.938347:0:14200:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4ba300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14200:1870604319945088:0@lo:104: 00010000:00010000:0.0:1783947657.938348:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947657.938354:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2e18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb2e1f expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947657.938364:0:14200:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb2eb2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.938370:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630200 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:0.0:1783947657.938374:0:14173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2e18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb2e1f expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.938383:0:14173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb2e1f expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947657.938390:0:14173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb2e1f expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947657.938396:0:14173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783947657.938447:0:14173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2e18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2e1f expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.938454:0:14173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783947657.938474:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2e18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2e1f expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.938482:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2e18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2e1f expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.938498:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947657.938514:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947657.938516:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947657.938528:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9e11f6c7-2161-442e-ac38-f4342317f92b:3314:1870604319945216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947657.938557:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947657.938609:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319945216 00000100:00100000:0.0:1783947657.938613:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319945216 00010000:00010000:0.0:1783947657.938629:0:14171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3cc0630a00/0x20c3e53e78bb2e1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb2e18 expref: 17 pid: 14178 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947657.938655:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947657.938662:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e11f6c7-2161-442e-ac38-f4342317f92b+17:3314:x1870604319945216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947657.938673:0:14171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947657.938678:0:14171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3cc0630a00/0x20c3e53e78bb2e1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb2e18 expref: 17 pid: 14178 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.938687:0:14171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3cc0630a00/0x20c3e53e78bb2e1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb2e18 expref: 17 pid: 14178 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.938699:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cc0630a00/0x20c3e53e78bb2e1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb2e18 expref: 17 pid: 14178 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.938710:0:14171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb2eb2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.938717:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb2eb2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783947657.938728:0:14171:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005361290s 00010000:00010000:0.0:1783947657.938732:0:14171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb2eb2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.938738:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb2eb2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.938744:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb2eb2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.938750:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb2eb2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.938761:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671e00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947657.938764:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb2eb2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.938772:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb2eb2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.938783:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb2eb2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947657.938790:0:14200:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb2eb2 lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947657.938791:0:14171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947657.938798:0:14200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb2eb2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947657.938804:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb2eb2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947657.938817:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e11f6c7-2161-442e-ac38-f4342317f92b+16:3314:x1870604319945216:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947657.938824:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947657.938853:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9e11f6c7-2161-442e-ac38-f4342317f92b:3314:1870604319945216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947657.953325:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+15:14818:x1870604319944960:12345-0@lo:253:mount.lustre.0 Request processed in 71379us (71456us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947657.953340:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783947657.953464:0:14818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:14818:1870604319944960:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783947657.953480:0:14818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783947657.953484:0:14818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783947657.953485:0:14818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783947657.953486:0:14818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947657.953488:0:14818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947657.953489:0:14818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947657.953490:0:14818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947657.953491:0:14818:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783947657.953493:0:14818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947657.953494:0:14818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783947657.953519:0:14818:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1783947657.966337:0:14818:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1783947657.966540:0:14818:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1783947657.968018:0:14818:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1783947657.968240:0:14818:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1783947657.968411:0:14818:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1783947657.968685:0:14818:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1783947657.971302:0:14818:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1783947658.034402:0:14818:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1783947658.034411:0:14818:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1783947658.034474:0:14818:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783947658.034545:0:14818:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.132@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783947658.034558:0:14818:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1783947658.034586:0:14818:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1783947658.170926:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947659.194066:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783947659.577505:0:14182:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783947659.577513:0:14182:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8b3cbd9ce000 from 7 10000000:01000000:2.0:1783947659.577518:0:14182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783947659.577558:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2eb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947659.577569:0:14182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2eb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947659.577589:0:14182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2eb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947659.577613:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319945344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783947659.577783:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947659.577837:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e063c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947659.577961:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319945344 00000100:00100000:0.0:1783947659.579248:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319945344 00000100:00100000:0.0:1783947659.579307:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783947659.579317:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+15:14182:x1870604319945344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947659.579333:0:14178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947659.580256:0:14178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb2ec0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb2eb9 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947659.580290:0:14178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb2ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb2eb9 expref: 16 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947659.580302:0:14178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb2ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2eb9 expref: 16 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947659.580312:0:14178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671600, rc 0) 00000100:00100000:0.0:1783947659.580740:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+16:14182:x1870604319945344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1422us (2954us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947659.580749:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783947659.580806:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319945344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947659.580825:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2eb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2ec0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947659.580836:0:14182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2eb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb2ec0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947659.580898:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319945472:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783947659.580936:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947659.581008:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87e063c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947659.581937:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319945472 00000100:00100000:1.0:1783947659.581952:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319945472 00000100:00100000:1.0:1783947659.582003:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783947659.582012:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+16:14182:x1870604319945472:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783947659.582032:0:14179:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783947659.582622:0:14179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783947659.582627:0:14179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1783947659.582756:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+16:14182:x1870604319945472:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 744us (1819us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947659.582774:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783947659.582790:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319945472:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783947659.582854:0:14182:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783947659.582863:0:14182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2eb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2ec0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947659.582879:0:14182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2ec0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.218021:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947661.241817:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947662.266615:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783947662.905552:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947662.905560:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947662.905563:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947662.905566:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783947662.905628:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319945728:0@lo:400:kworker.0 00000100:00100000:0.0:1783947662.905692:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947662.905759:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947662.905779:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9e11f6c7-2161-442e-ac38-f4342317f92b:3312:1870604319945600:0@lo:400:kworker.0 00000100:00100000:0.0:1783947662.905809:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947662.905840:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319945856:0@lo:400:kworker.0 00000100:00100000:0.0:1783947662.905868:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947662.905920:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319945728 00000100:00100000:0.0:1783947662.905928:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319945728 00000100:00100000:0.0:1783947662.906006:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319945856 00000100:00100000:0.0:1783947662.906010:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319945856 00000100:00100000:0.0:1783947662.906042:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947662.906050:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319945728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947662.906101:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870604319945728:12345-0@lo:400:kworker.0 Request processed in 50us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947662.906108:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947662.906124:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947662.906131:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319945856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947662.906161:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319945856:12345-0@lo:400:kworker.0 Request processed in 31us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947662.906167:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947662.906186:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319945600 00000100:00100000:0.0:1783947662.906189:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319945600 00000100:00100000:0.0:1783947662.906211:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783947662.906217:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+16:3312:x1870604319945600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947662.906241:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+16:3312:x1870604319945600:12345-0@lo:400:kworker.0 Request processed in 25us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947662.906246:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1783947662.906294:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3cbd4b8a80 x1870604319945856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947662.906320:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319945856:0@lo:400:kworker.0 00000100:00100000:0.0:1783947662.906351:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9e11f6c7-2161-442e-ac38-f4342317f92b:3312:1870604319945600:0@lo:400:kworker.0 00010000:00080000:0.0:1783947662.906360:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3cbd4b9180 x1870604319945728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947662.906369:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870604319945728:0@lo:400:kworker.0 00000100:00080000:0.0:1783947662.906413:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783947663.290081:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947664.318236:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783947664.832010:0:15200:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783947665.344462:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947666.362520:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947667.385588:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783947667.707981:0:14219:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783947668.031866:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9e11f6c7-2161-442e-ac38-f4342317f92b:3314:1870604319945984:0@lo:400:kworker.0 00000100:00100000:0.0:1783947668.031973:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783947668.032078:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947668.032086:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783947668.032089:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947668.032093:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783947668.032168:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319946112:0@lo:400:kworker.0 00000100:00100000:2.0:1783947668.032205:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947668.032240:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783947668.032246:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319946240:0@lo:400:kworker.0 00000100:00100000:2.0:1783947668.032290:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947668.032330:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319946112 00000100:00100000:2.0:1783947668.032340:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319946112 00000100:00100000:2.0:1783947668.032392:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319946240 00000100:00100000:2.0:1783947668.032396:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319946240 00000100:00100000:2.0:1783947668.032458:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783947668.032468:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319946112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947668.032649:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319945984 00000100:00100000:3.0:1783947668.032654:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319945984 00000100:00100000:3.0:1783947668.032827:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783947668.032837:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+16:3314:x1870604319945984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947668.034616:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319946112:12345-0@lo:400:kworker.0 Request processed in 2137us (2397us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947668.034633:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783947668.034677:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783947668.034690:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319946240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947668.034734:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319946240:12345-0@lo:400:kworker.0 Request processed in 50us (2443us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947668.034740:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1783947668.034782:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783947668.034827:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3cb6aeca80 x1870604319946240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947668.034845:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319946240:0@lo:400:kworker.0 00010000:00080000:2.0:1783947668.034860:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3cb6aed180 x1870604319946112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947668.034869:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319946112:0@lo:400:kworker.0 00000100:00100000:3.0:1783947668.045530:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+16:3314:x1870604319945984:12345-0@lo:400:kworker.0 Request processed in 12679us (13541us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947668.045552:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783947668.052173:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9e11f6c7-2161-442e-ac38-f4342317f92b:3314:1870604319945984:0@lo:400:kworker.0 00010000:00010000:0.0:1783947668.422380:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947669.433771:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947670.140668:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947655/real 1783947655] req@ffff8b3b850d2300 x1870604319942016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947670 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947670.140700:0:3310:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b3b850d2300 x1870604319942016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947670 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947670.140729:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947655/real 1783947655] req@ffff8b3b850d1c00 x1870604319942144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947670 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947670.140742:0:3310:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b3b850d1c00 x1870604319942144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947670 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783947670.140761:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3c9e6c6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783947670.140785:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783947670.140790:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319942016:0@lo:8:kworker.0 00000100:00080000:2.0:1783947670.140796:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3c8579e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783947670.140801:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783947670.140804:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319942144:0@lo:8:kworker.0 00000100:00080000:0.0:1783947670.140962:0:12650:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947670.140967:0:12650:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783947670.140969:0:12650:0:(import.c:65:import_set_state_nolock()) ffff8b3c9e6c6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947670.140974:0:12650:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 471 00000100:00080000:0.0:1783947670.140979:0:12650:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783947670.140986:0:12650:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8b3c9e6c6000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1783947670.141004:0:12650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3cbd4b9f80 x1870604319946496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783947670.141017:0:12650:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947670.141025:0:12650:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783947670.141027:0:12650:0:(import.c:65:import_set_state_nolock()) ffff8b3c8579e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947670.141031:0:12650:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 471 00000100:00080000:0.0:1783947670.141033:0:12650:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783947670.141038:0:12650:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8b3c8579e000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1783947670.141050:0:12650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3cbd4b8a80 x1870604319946624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783947670.141096:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870604319946752:0@lo:400:kworker.0 00000100:00100000:0.0:1783947670.141153:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947670.141389:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947670.141396:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9e11f6c7-2161-442e-ac38-f4342317f92b:3314:1870604319946368:0@lo:400:kworker.0 00000100:00100000:0.0:1783947670.141459:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947670.141492:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319946368 00000100:00100000:0.0:1783947670.141498:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319946368 00000100:00100000:0.0:1783947670.141539:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783947670.141547:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+16:3314:x1870604319946368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947670.141604:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+16:3314:x1870604319946368:12345-0@lo:400:kworker.0 Request processed in 57us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947670.141611:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783947670.141652:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9e11f6c7-2161-442e-ac38-f4342317f92b:3314:1870604319946368:0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.141840:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319946880:0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.141867:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947670.141908:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319946752 00000100:00100000:2.0:1783947670.141912:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319946752 00000100:00100000:2.0:1783947670.141938:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319946880 00000100:00100000:2.0:1783947670.141941:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319946880 00000100:00100000:2.0:1783947670.141961:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947670.141967:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870604319946752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.142003:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870604319946752:12345-0@lo:400:kworker.0 Request processed in 37us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947670.142009:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947670.142022:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783947670.142028:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319946880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.142057:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319946880:12345-0@lo:400:kworker.0 Request processed in 29us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947670.142069:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1783947670.142092:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783947670.142112:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3cbd4bbb80 x1870604319946752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947670.142122:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870604319946752:0@lo:400:kworker.0 00010000:00080000:2.0:1783947670.142142:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3cbd4b8000 x1870604319946880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947670.142150:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319946880:0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.142503:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319946496:0@lo:8:kworker.0 00000100:00100000:2.0:1783947670.142535:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947670.142715:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319946624:0@lo:8:kworker.0 00000100:00100000:2.0:1783947670.142740:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947670.148388:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319946496 00000100:00100000:3.0:1783947670.148401:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319946496 00000100:00100000:3.0:1783947670.148465:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319946624 00000100:00100000:3.0:1783947670.148469:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319946624 00000100:00100000:3.0:1783947670.148486:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947670.148494:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1870604319946496:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1783947670.148527:0:14819:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:3.0:1783947670.148557:0:14819:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20c3e53e78bb2ec7 00002000:00100000:3.0:1783947670.148586:0:14819:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8b3c82bef800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1783947670.148591:0:14819:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1783947670.148594:0:14819:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783947670.148897:0:14819:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783947670.148922:0:14819:0:(import.c:65:import_set_state_nolock()) ffff8b3c82be9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947670.149000:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1870604319946496:12345-0@lo:8:kworker.0 Request processed in 506us (6464us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947670.149008:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947670.149036:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947670.149041:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1870604319946624:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1783947670.149052:0:14819:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783947670.149082:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1870604319946624:12345-0@lo:8:kworker.0 Request processed in 39us (6341us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783947670.149088:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783947670.149128:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3cbd4b9f80 x1870604319946496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783947690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947670.149139:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783947670.149146:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1783947670.149153:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783947670.149158:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1783947670.149160:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3c9e6c6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783947670.149400:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783947670.149407:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319946496:0@lo:8:kworker.0 00000100:00080000:3.0:1783947670.149453:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3c8579e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783947670.149457:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783947670.149460:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319946624:0@lo:8:kworker.0 00000004:00080000:3.0:1783947670.149524:0:14207:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1783947670.149543:0:14207:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14207:1870604319947136:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783947670.149700:0:14206:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783947670.149917:0:14206:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 485420497463ns, next at 0ns, rc = 0 00000100:00100000:3.0:1783947670.150339:0:14207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947670.150379:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319947008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947670.150410:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947670.150469:0:14207:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3ca0901b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947670.150553:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319947136 00000100:00100000:0.0:1783947670.150561:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319947136 00000100:00100000:0.0:1783947670.150663:0:14823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319947008 00000100:00100000:0.0:1783947670.150668:0:14823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319947008 00000100:00100000:0.0:1783947670.150707:0:14823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783947670.150715:0:14823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1870604319947008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947670.150750:0:14823:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947670.150790:0:14823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1870604319947008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947670.150797:0:14823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1783947670.150939:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783947670.150969:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3b850d0380 x1870604319947008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947670.150986:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319947008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947670.151041:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783947670.151049:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14207:x1870604319947136:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1783947670.171147:0:14821:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1783947670.171157:0:14821:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1783947670.171162:0:14821:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1783947670.185383:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.185394:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009167a93f/0x20c3e53e78bb2ece lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.185410:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.185415:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.185456:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009167a93f/0x20c3e53e78bb2ece lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.185475:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009167a93f/0x20c3e53e78bb2ece lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.185487:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009167a93f/0x20c3e53e78bb2ece lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.185494:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009167a93f/0x20c3e53e78bb2ece lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.185514:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947670.185676:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947670.185683:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009167a93f/0x20c3e53e78bb2ece lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.185692:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1b200 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947670.185697:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009167a93f/0x20c3e53e78bb2ece lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.185706:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009167a93f/0x20c3e53e78bb2ece lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.185725:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009167a93f/0x20c3e53e78bb2ece lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.185734:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009167a93f/0x20c3e53e78bb2ece lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.185756:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947670.185758:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947670.185760:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947670.188827:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.188840:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000811fa5c0/0x20c3e53e78bb2ed5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.188862:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.188866:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.188872:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000811fa5c0/0x20c3e53e78bb2ed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.188886:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000811fa5c0/0x20c3e53e78bb2ed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.188896:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000811fa5c0/0x20c3e53e78bb2ed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.188905:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000811fa5c0/0x20c3e53e78bb2ed5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.188921:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947670.188932:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947670.188937:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000811fa5c0/0x20c3e53e78bb2ed5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.188945:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1aa00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947670.188950:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000811fa5c0/0x20c3e53e78bb2ed5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.188958:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000811fa5c0/0x20c3e53e78bb2ed5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.188983:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000811fa5c0/0x20c3e53e78bb2ed5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.188991:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000811fa5c0/0x20c3e53e78bb2ed5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.189007:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.189008:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.189010:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947670.191863:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.191875:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000087b9448/0x20c3e53e78bb2edc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.191891:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.191895:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.191901:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000087b9448/0x20c3e53e78bb2edc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.191914:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000087b9448/0x20c3e53e78bb2edc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.191925:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000087b9448/0x20c3e53e78bb2edc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.191932:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000087b9448/0x20c3e53e78bb2edc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.191960:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947670.191974:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947670.191979:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000087b9448/0x20c3e53e78bb2edc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.191987:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a800 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947670.191991:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000087b9448/0x20c3e53e78bb2edc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.192000:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000087b9448/0x20c3e53e78bb2edc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.192014:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000087b9448/0x20c3e53e78bb2edc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.192021:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000087b9448/0x20c3e53e78bb2edc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.192037:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.192039:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.192040:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947670.197406:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.197445:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2ee3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.197464:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.197475:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.197482:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2ee3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.197496:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2ee3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.197507:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2ee3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.197514:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2ee3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.197537:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947670.197656:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947670.197664:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2ee3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947670.197672:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1ae00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947670.197677:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2ee3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947670.197686:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2ee3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947670.197717:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2ee3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947670.197726:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2ee3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947670.197745:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947670.197747:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947670.197749:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947670.199164:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.201135:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2eea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.201151:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.201155:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.201162:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2eea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.201337:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2eea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.201347:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2eea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.201362:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2eea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.201380:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947670.201821:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947670.201829:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2eea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.201847:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a400 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947670.201851:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2eea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.201859:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2eea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.201873:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2eea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.201881:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2eea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.201899:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947670.201901:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947670.201902:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947670.202741:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.202748:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e12fc5e9/0x20c3e53e78bb2ef1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.202758:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.202762:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.202767:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e12fc5e9/0x20c3e53e78bb2ef1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.202778:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e12fc5e9/0x20c3e53e78bb2ef1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.202786:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e12fc5e9/0x20c3e53e78bb2ef1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.202792:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e12fc5e9/0x20c3e53e78bb2ef1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.202811:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947670.202821:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947670.202826:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e12fc5e9/0x20c3e53e78bb2ef1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.202840:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1b400 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947670.202844:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e12fc5e9/0x20c3e53e78bb2ef1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.202852:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e12fc5e9/0x20c3e53e78bb2ef1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.202864:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e12fc5e9/0x20c3e53e78bb2ef1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.202871:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e12fc5e9/0x20c3e53e78bb2ef1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.202885:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.202887:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.202888:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947670.204800:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.204811:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2ef8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.204823:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.204828:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.204833:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2ef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.204845:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2ef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.204863:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2ef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.204870:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2ef8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.204884:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947670.204893:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947670.204900:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2ef8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.204907:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147d200 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947670.204911:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2ef8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.204920:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2ef8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.204934:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2ef8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.204942:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2ef8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.204957:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.204964:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.204966:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947670.205890:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.205897:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2eff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.205906:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.205909:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.205913:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2eff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.205922:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2eff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.205930:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2eff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.205936:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2eff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.208103:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783947670.208886:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.208895:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.208911:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.208915:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.208922:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.208942:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.208952:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.208960:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783947670.213118:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1783947670.213613:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947670.213623:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2eff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947670.213636:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147c200 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947670.213640:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2eff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947670.213652:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2eff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947670.213672:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2eff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947670.213680:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2eff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947670.214099:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947670.214105:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947670.214113:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147de00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947670.214117:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947670.214124:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947670.214135:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947670.214143:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947670.214145:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947670.214147:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947670.215823:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.216000:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783947670.216012:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947670.218621:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.218633:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080c704a3/0x20c3e53e78bb2f0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.218647:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.218652:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.218658:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080c704a3/0x20c3e53e78bb2f0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.218672:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080c704a3/0x20c3e53e78bb2f0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.218693:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080c704a3/0x20c3e53e78bb2f0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.218701:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080c704a3/0x20c3e53e78bb2f0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.218717:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783947670.219632:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.219639:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022a6bd3f/0x20c3e53e78bb2f14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.219649:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.219653:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.219657:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022a6bd3f/0x20c3e53e78bb2f14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.219667:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022a6bd3f/0x20c3e53e78bb2f14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.219675:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022a6bd3f/0x20c3e53e78bb2f14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.219683:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022a6bd3f/0x20c3e53e78bb2f14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.219714:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783947670.220123:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.220129:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb2f1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.220138:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.220141:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.220145:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb2f1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.220154:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb2f1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.220162:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb2f1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.221100:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb2f1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.221361:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947670.221370:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080c704a3/0x20c3e53e78bb2f0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.221379:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147d800 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947670.221383:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080c704a3/0x20c3e53e78bb2f0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.221408:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080c704a3/0x20c3e53e78bb2f0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.221458:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080c704a3/0x20c3e53e78bb2f0d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.221467:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080c704a3/0x20c3e53e78bb2f0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.221489:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947670.221493:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022a6bd3f/0x20c3e53e78bb2f14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.221499:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147c800 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947670.221502:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022a6bd3f/0x20c3e53e78bb2f14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.221509:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022a6bd3f/0x20c3e53e78bb2f14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.221518:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022a6bd3f/0x20c3e53e78bb2f14 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.221524:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022a6bd3f/0x20c3e53e78bb2f14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.221549:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.221551:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.221553:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.221718:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783947670.224370:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.224383:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040f79462/0x20c3e53e78bb2f22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.224399:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.224404:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.224410:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040f79462/0x20c3e53e78bb2f22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.224447:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040f79462/0x20c3e53e78bb2f22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.224458:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040f79462/0x20c3e53e78bb2f22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.224465:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040f79462/0x20c3e53e78bb2f22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.224521:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947670.224530:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb2f1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.224538:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147ce00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:2.0:1783947670.224543:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb2f1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.224552:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb2f1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.224598:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb2f1b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.224607:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae69f4c2/0x20c3e53e78bb2f1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.224630:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947670.224633:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040f79462/0x20c3e53e78bb2f22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.224640:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147da00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:2.0:1783947670.224644:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040f79462/0x20c3e53e78bb2f22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.224652:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040f79462/0x20c3e53e78bb2f22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.224662:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040f79462/0x20c3e53e78bb2f22 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.224669:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947670.224671:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947670.224672:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947670.228366:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.228716:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783947670.228735:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040f79462/0x20c3e53e78bb2f22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947670.230758:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.230769:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.230784:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.230789:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.230795:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.230809:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.230818:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.230825:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.233403:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947670.234887:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.234919:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147de00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:2.0:1783947670.234924:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.234935:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.234955:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f29 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.234966:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947670.234968:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947670.234971:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.235028:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783947670.235036:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000257203e7/0x20c3e53e78bb2f29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947670.235992:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.236000:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2f30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.236023:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.236028:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.236034:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2f30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.236047:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2f30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.236056:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2f30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.236063:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2f30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.236081:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783947670.236454:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947670.236461:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2f30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.236469:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147d200 already unused, calling callback (ffffffffc1552360) 00010000:00010000:2.0:1783947670.236473:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2f30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.236482:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2f30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.236494:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2f30 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.236508:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006661bd53/0x20c3e53e78bb2f30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.236525:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947670.236527:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947670.236529:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947670.236814:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947670.244644:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.244657:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4f8a8a9/0x20c3e53e78bb2f37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.244672:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.244677:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.244682:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4f8a8a9/0x20c3e53e78bb2f37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.244695:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4f8a8a9/0x20c3e53e78bb2f37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.244715:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4f8a8a9/0x20c3e53e78bb2f37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.244734:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4f8a8a9/0x20c3e53e78bb2f37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.244758:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783947670.244853:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947670.244860:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4f8a8a9/0x20c3e53e78bb2f37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.244869:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147d000 already unused, calling callback (ffffffffc1552360) 00010000:00010000:2.0:1783947670.244873:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4f8a8a9/0x20c3e53e78bb2f37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.244882:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4f8a8a9/0x20c3e53e78bb2f37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.244898:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4f8a8a9/0x20c3e53e78bb2f37 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.244905:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4f8a8a9/0x20c3e53e78bb2f37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.244922:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947670.244924:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947670.244925:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947670.245289:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.245295:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2f3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.245302:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.245305:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.245309:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2f3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.245319:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2f3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.245327:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2f3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.245335:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2f3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.245369:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783947670.245675:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947670.245681:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2f3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.245689:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147ca00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:2.0:1783947670.245694:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2f3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.245702:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2f3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.245713:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2f3e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.245730:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000609c435c/0x20c3e53e78bb2f3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.245745:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947670.245747:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947670.245748:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947670.245798:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.245803:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aa5dab4/0x20c3e53e78bb2f45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.245812:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.245815:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.245820:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008aa5dab4/0x20c3e53e78bb2f45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.245829:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008aa5dab4/0x20c3e53e78bb2f45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.245837:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aa5dab4/0x20c3e53e78bb2f45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.245843:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008aa5dab4/0x20c3e53e78bb2f45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.245862:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783947670.246218:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.246224:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2f4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.246232:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.246240:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.246244:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2f4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.246254:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2f4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.246263:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2f4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.246270:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2f4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.246285:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783947670.246294:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947670.246298:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008aa5dab4/0x20c3e53e78bb2f45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.246305:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147d600 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947670.246308:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008aa5dab4/0x20c3e53e78bb2f45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.246315:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008aa5dab4/0x20c3e53e78bb2f45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.246326:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008aa5dab4/0x20c3e53e78bb2f45 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.246346:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008aa5dab4/0x20c3e53e78bb2f45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.246351:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947670.246359:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.246361:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.246362:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947670.246766:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.246773:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2f53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.246781:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.246784:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.246788:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2f53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.246797:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2f53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.246804:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2f53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.246810:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2f53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.246829:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783947670.246905:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947670.246910:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2f53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.246918:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a400 already unused, calling callback (ffffffffc1552360) 00010000:00010000:2.0:1783947670.246922:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2f53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.246940:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2f53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.246952:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2f53 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.246959:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009d64a8f/0x20c3e53e78bb2f53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.246974:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947670.246976:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947670.246977:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947670.247205:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783947670.247215:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2f5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.247224:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1783947670.247227:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947670.247231:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2f5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.247240:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2f5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.247248:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2f5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.247255:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2f5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.247275:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783947670.247358:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947670.247363:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2f5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.247370:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1ae00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:2.0:1783947670.247373:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2f5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.247381:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2f5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.247393:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2f5a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.247410:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa799d68/0x20c3e53e78bb2f5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.247470:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947670.247471:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947670.247472:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947670.248701:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947670.248706:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947670.248708:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947670.248791:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2f4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947670.248802:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147c200 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947670.248807:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2f4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947670.248828:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2f4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947670.248843:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2f4c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947670.248850:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000488f9420/0x20c3e53e78bb2f4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947670.248867:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947670.248869:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947670.248871:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947670.257891:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783947670.257903:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b31dd95/0x20c3e53e78bb2f61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.257919:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1783947670.257924:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947670.257930:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b31dd95/0x20c3e53e78bb2f61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.257943:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b31dd95/0x20c3e53e78bb2f61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.257954:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b31dd95/0x20c3e53e78bb2f61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.257961:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b31dd95/0x20c3e53e78bb2f61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.258001:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947670.258201:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947670.258209:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b31dd95/0x20c3e53e78bb2f61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.258217:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631600 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947670.258222:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b31dd95/0x20c3e53e78bb2f61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.258231:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b31dd95/0x20c3e53e78bb2f61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.258254:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b31dd95/0x20c3e53e78bb2f61 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.258263:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b31dd95/0x20c3e53e78bb2f61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.258279:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.258281:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.258283:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947670.258935:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783947670.258942:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056eede39/0x20c3e53e78bb2f68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.258952:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1783947670.258956:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947670.258960:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056eede39/0x20c3e53e78bb2f68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.258971:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056eede39/0x20c3e53e78bb2f68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.258979:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056eede39/0x20c3e53e78bb2f68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.258987:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056eede39/0x20c3e53e78bb2f68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.259013:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947670.259278:0:15408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947670.259285:0:15408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056eede39/0x20c3e53e78bb2f68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.259293:0:15408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630800 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947670.259297:0:15408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056eede39/0x20c3e53e78bb2f68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.259304:0:15408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056eede39/0x20c3e53e78bb2f68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.259316:0:15408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056eede39/0x20c3e53e78bb2f68 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.259324:0:15408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056eede39/0x20c3e53e78bb2f68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.259350:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.259352:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.259354:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947670.260728:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783947670.260737:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000809e7c23/0x20c3e53e78bb2f6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.260749:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1783947670.260759:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947670.260765:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000809e7c23/0x20c3e53e78bb2f6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.260777:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000809e7c23/0x20c3e53e78bb2f6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.260786:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000809e7c23/0x20c3e53e78bb2f6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.260793:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000809e7c23/0x20c3e53e78bb2f6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.260812:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783947670.261398:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783947670.261404:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042ffc5c5/0x20c3e53e78bb2f76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.261413:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1783947670.261448:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947670.261453:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042ffc5c5/0x20c3e53e78bb2f76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.261463:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042ffc5c5/0x20c3e53e78bb2f76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.261471:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042ffc5c5/0x20c3e53e78bb2f76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.261485:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042ffc5c5/0x20c3e53e78bb2f76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.261497:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783947670.261552:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947670.261560:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000809e7c23/0x20c3e53e78bb2f6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.261568:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631c00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947670.261572:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000809e7c23/0x20c3e53e78bb2f6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.261581:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000809e7c23/0x20c3e53e78bb2f6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.261596:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000809e7c23/0x20c3e53e78bb2f6f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.261604:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000809e7c23/0x20c3e53e78bb2f6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.261620:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947670.261624:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042ffc5c5/0x20c3e53e78bb2f76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.261629:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631000 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947670.261639:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042ffc5c5/0x20c3e53e78bb2f76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.261646:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042ffc5c5/0x20c3e53e78bb2f76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.261656:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042ffc5c5/0x20c3e53e78bb2f76 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.261663:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042ffc5c5/0x20c3e53e78bb2f76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.261675:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.261677:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.261679:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.261687:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947670.262093:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783947670.262099:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc8392a8/0x20c3e53e78bb2f7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.262107:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1783947670.262111:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947670.262115:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc8392a8/0x20c3e53e78bb2f7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.262124:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc8392a8/0x20c3e53e78bb2f7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.262132:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc8392a8/0x20c3e53e78bb2f7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.262138:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc8392a8/0x20c3e53e78bb2f7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947670.262161:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947670.262285:0:15408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947670.262291:0:15408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc8392a8/0x20c3e53e78bb2f7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.262298:0:15408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631800 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947670.262302:0:15408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc8392a8/0x20c3e53e78bb2f7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.262310:0:15408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc8392a8/0x20c3e53e78bb2f7d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.262320:0:15408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc8392a8/0x20c3e53e78bb2f7d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.262334:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.262336:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.262338:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947670.262340:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc8392a8/0x20c3e53e78bb2f7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783947670.263941:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783947670.263951:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2f84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.263963:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1783947670.263967:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947670.263972:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2f84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.263995:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2f84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.264004:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2f84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.264010:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2f84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.264031:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947670.264097:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947670.264105:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2f84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.264113:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671e00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947670.264117:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2f84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.264124:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2f84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.264137:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2f84 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.264143:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074cc86c1/0x20c3e53e78bb2f84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.264174:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.264176:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.264178:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783947670.264808:0:14821:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783947670.264815:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a9cd4bd/0x20c3e53e78bb2f8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.264824:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1783947670.264828:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947670.264832:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a9cd4bd/0x20c3e53e78bb2f8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.264841:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a9cd4bd/0x20c3e53e78bb2f8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.264849:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a9cd4bd/0x20c3e53e78bb2f8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.264866:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a9cd4bd/0x20c3e53e78bb2f8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947670.264884:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1783947670.265064:0:14821:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1783947670.265376:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14207:x1870604319947136:12345-0@lo:5:osp-pre-0-0.0 Request processed in 114323us (115032us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947670.265387:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1783947670.265451:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947670.265840:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a9cd4bd/0x20c3e53e78bb2f8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.265861:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85670c00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947670.265865:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a9cd4bd/0x20c3e53e78bb2f8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.265874:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a9cd4bd/0x20c3e53e78bb2f8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.265888:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a9cd4bd/0x20c3e53e78bb2f8b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.265896:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a9cd4bd/0x20c3e53e78bb2f8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947670.265912:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.265914:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947670.265916:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947670.266838:0:14207:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14207:1870604319947136:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783947670.266854:0:14207:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1783947670.271092:0:14207:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14207:1870604319947264:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783947670.271158:0:14207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947670.275388:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319947264 00000100:00100000:1.0:1783947670.275402:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319947264 00000100:00100000:1.0:1783947670.275476:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947670.275486:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14207:x1870604319947264:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1783947670.275533:0:14819:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1783947670.276314:0:14207:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947670.287719:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14207:x1870604319947264:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12226us (16551us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1783947670.287790:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783947670.287938:0:14207:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14207:1870604319947264:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783947670.287954:0:14207:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1783947670.457877:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947671.482017:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783947672.090992:0:15503:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783947672.091010:0:15503:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1783947672.091247:0:15503:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8b3cb6185000 00000020:01000004:2.0:1783947672.091264:0:15503:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783947672.091277:0:15503:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1783947672.091319:0:15503:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8b3b853619c0) 00000020:00000080:2.0:1783947672.091337:0:15503:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783947672.127369:0:15503:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783947672.128814:0:15503:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1783947672.129953:0:15503:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783947672.130191:0:15503:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1783947672.130439:0:15503:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1783947672.130907:0:15503:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 287: rc = 0 00100000:10000000:2.0:1783947672.131001:0:15503:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 287: rc = 0 00100000:10000000:2.0:1783947672.131095:0:15503:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 287: rc = 0 00100000:10000000:2.0:1783947672.131903:0:15503:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 322: rc = 0 00100000:10000000:2.0:1783947672.133067:0:15503:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 322: rc = 0 00100000:10000000:2.0:1783947672.133335:0:15503:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 322: rc = 0 00100000:10000000:2.0:1783947672.133800:0:15503:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 322: rc = 0 00100000:10000000:2.0:1783947672.134142:0:15503:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 322: rc = 0 00100000:10000000:2.0:1783947672.134399:0:15503:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 322: rc = 0 00000020:00000080:2.0:1783947672.135135:0:15503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1783947672.135147:0:15503:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783947672.135157:0:15503:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x20c3e53e78bb2f99 00000020:01000004:2.0:1783947672.135360:0:15503:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1783947672.135383:0:15503:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.132@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783947672.135412:0:15503:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783947672.135508:0:15503:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1783947672.135532:0:15503:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1783947672.135536:0:15503:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.132@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1783947672.146088:0:15503:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.132@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783947672.146237:0:15503:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.132@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1783947672.146241:0:15503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783947672.146243:0:15503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783947672.146245:0:15503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947672.146246:0:15503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947672.146247:0:15503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947672.146249:0:15503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947672.146250:0:15503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947672.146252:0:15503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947672.146253:0:15503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783947672.146257:0:15503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1783947672.146259:0:15503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783947672.146260:0:15503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783947672.146261:0:15503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947672.146263:0:15503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947672.146264:0:15503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947672.146265:0:15503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947672.146266:0:15503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947672.146267:0:15503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947672.146268:0:15503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783947672.146292:0:15503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1783947672.146314:0:15503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319947392:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783947672.146392:0:15503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947672.146543:0:15503:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85cd2840 going to sleep for 11 seconds 00000100:00100000:3.0:1783947672.146733:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319947392 00000100:00100000:3.0:1783947672.146740:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319947392 00000100:00100000:3.0:1783947672.146828:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783947672.146839:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+16:15503:x1870604319947392:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783947672.146867:0:14179:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1783947672.146878:0:14179:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1783947672.146883:0:14179:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1783947672.179783:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+16:15503:x1870604319947392:12345-0@lo:253:mount.lustre.0 Request processed in 32939us (33383us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947672.179799:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783947672.179960:0:15503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319947392:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783947672.179974:0:15503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783947672.179977:0:15503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783947672.179979:0:15503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783947672.179980:0:15503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947672.179981:0:15503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947672.179995:0:15503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947672.179997:0:15503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947672.179998:0:15503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947672.180000:0:15503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947672.180001:0:15503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783947672.180022:0:15503:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b3cb6185000 from lustre-OST0001 10000000:01000000:2.0:1783947672.180048:0:15503:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1783947672.180051:0:15503:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1783947672.180058:0:15503:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8b3c857619c0 local copy 00010000:00010000:2.0:1783947672.180067:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb2d3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2d46 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947672.180855:0:15503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319947520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947672.180893:0:15503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947672.180998:0:15503:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85cd2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947672.181669:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319947520 00000100:00100000:0.0:1783947672.181857:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319947520 00000100:00100000:2.0:1783947672.182029:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783947672.182040:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+16:15503:x1870604319947520:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947672.182796:0:15503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319947520:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783947672.182815:0:15503:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:2.0:1783947672.183041:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+16:15503:x1870604319947520:12345-0@lo:501:mount.lustre.0 Request processed in 1000us (2144us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783947672.183051:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 10000000:01000000:0.0:1783947672.183337:0:15503:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783947672.183346:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb2d3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2d46 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.183356:0:15503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c85670a00/0x20c3e53e78bb2d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2d46 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947672.183391:0:15503:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b3cb6185000 10000000:01000000:0.0:1783947672.183396:0:15503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783947672.183401:0:15503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783947672.183413:0:15503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783947672.183452:0:15503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1783947672.183456:0:15503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783947672.183487:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85670400/0x20c3e53e78bb2fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.183494:0:15503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3c85670400/0x20c3e53e78bb2fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.183505:0:15503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3c85670400/0x20c3e53e78bb2fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947672.183524:0:15503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319947648:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783947672.183576:0:15503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947672.183845:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319947648 00000100:00100000:3.0:1783947672.183852:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319947648 00000100:00100000:3.0:1783947672.183892:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783947672.183901:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+16:15503:x1870604319947648:12345-0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783947672.183957:0:15503:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c81377900 going to sleep for 11 seconds 00010000:00010000:3.0:1783947672.183985:0:14179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947672.184001:0:14179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3ca9d1b400/0x20c3e53e78bb2fa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb2fa0 expref: -99 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947672.184024:0:14179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3ca9d1b400/0x20c3e53e78bb2fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb2fa0 expref: 17 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947672.184035:0:14179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3ca9d1b400/0x20c3e53e78bb2fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2fa0 expref: 17 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947672.184044:0:14179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1b400, rc 0) 00000100:00100000:3.0:1783947672.184085:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+17:15503:x1870604319947648:12345-0@lo:101:mount.lustre.0 Request processed in 186us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947672.184092:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783947672.184382:0:15503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319947648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947672.184444:0:15503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3c85670400/0x20c3e53e78bb2fa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2fa7 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947672.184454:0:15503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3c85670400/0x20c3e53e78bb2fa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb2fa7 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783947672.185079:0:15503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1783947672.188003:0:15503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783947672.189472:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1783947672.189523:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1783947672.189542:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1783947672.189575:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1783947672.189610:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1783947672.189644:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1783947672.189725:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1783947672.189734:0:15503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1783947672.189833:0:15503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319947776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947672.189895:0:15503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947672.190003:0:15503:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947672.190078:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319947776 00000100:00100000:2.0:1783947672.190086:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319947776 00000100:00100000:2.0:1783947672.190137:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783947672.190145:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+17:15503:x1870604319947776:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947672.192067:0:15503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319947776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947672.192083:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+17:15503:x1870604319947776:12345-0@lo:501:mount.lustre.0 Request processed in 1939us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947672.192093:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783947672.192111:0:15503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319947904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947672.192150:0:15503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947672.192181:0:15503:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947672.192458:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319947904 00000100:00100000:0.0:1783947672.192464:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319947904 00000100:00100000:0.0:1783947672.192503:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783947672.192511:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+17:15503:x1870604319947904:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783947672.193482:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+17:15503:x1870604319947904:12345-0@lo:503:mount.lustre.0 Request processed in 967us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947672.193491:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783947672.193550:0:15503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319947904:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783947672.194114:0:15503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783947672.194182:0:15503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319948032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783947672.194234:0:15503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947672.194261:0:15503:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947672.197041:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319948032 00000100:00100000:2.0:1783947672.197054:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319948032 00000100:00100000:2.0:1783947672.197170:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783947672.197180:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+17:15503:x1870604319948032:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947672.197534:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+17:15503:x1870604319948032:12345-0@lo:502:mount.lustre.0 Request processed in 355us (3299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947672.197542:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783947672.197978:0:15503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319948032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783947672.198259:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1783947672.198329:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1783947672.198365:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1783947672.198456:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1783947672.198495:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1783947672.198528:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1783947672.198573:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1783947672.198606:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1783947672.198650:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1783947672.198690:0:15503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319948160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783947672.198742:0:15503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947672.200612:0:15503:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783947672.208201:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319948160 00000100:00100000:3.0:1783947672.208215:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319948160 00000100:00100000:1.0:1783947672.209018:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783947672.209030:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+17:15503:x1870604319948160:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783947672.209297:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+17:15503:x1870604319948160:12345-0@lo:502:mount.lustre.0 Request processed in 269us (10554us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947672.209315:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783947672.210400:0:15503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319948160:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783947672.210690:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1783947672.210707:0:15503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1783947672.213552:0:15504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783947672.215523:0:15504:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1783947672.215538:0:15504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947672.215540:0:15504:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1783947672.215564:0:15504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783947672.215583:0:15504:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8b3b85364d40) 00000020:00000080:2.0:1783947672.215607:0:15504:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783947672.215614:0:15504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783947672.215688:0:15504:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b3cb6185000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1783947672.215696:0:15504:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783947672.215702:0:15504:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x20c3e53e78bb2fb5 00010000:00010000:2.0:1783947672.223526:0:15504:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1783947672.223908:0:15504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1783947672.225627:0:15504:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1783947672.227394:0:15504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1783947672.227414:0:15504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947672.227456:0:15504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947672.227458:0:15504:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1783947672.227462:0:15504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947672.227473:0:15504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947672.227475:0:15504:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783947672.227479:0:15504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783947672.227481:0:15504:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783947672.227484:0:15504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947672.227486:0:15504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947672.227488:0:15504:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783947672.227490:0:15504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947672.227492:0:15504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947672.227493:0:15504:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783947672.227496:0:15504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783947672.227550:0:15504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947672.227555:0:15504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947672.227556:0:15504:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783947672.227772:0:15504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1783947672.227919:0:15503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1783947672.227947:0:15503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783947672.227968:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85670400/0x20c3e53e78bb2fa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2fa7 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947672.227980:0:15503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c85670400/0x20c3e53e78bb2fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2fa7 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947672.227988:0:15503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3cb6185000 from 1 10000000:01000000:1.0:1783947672.227991:0:15503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947672.228032:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825200/0x20c3e53e78bb2fbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947672.228041:0:15503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825200/0x20c3e53e78bb2fbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947672.228052:0:15503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825200/0x20c3e53e78bb2fbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947672.228076:0:15503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319948288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783947672.228141:0:15503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947672.228184:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319948288 00000100:00100000:1.0:1783947672.228191:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319948288 00000100:00100000:1.0:1783947672.228239:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783947672.228248:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+17:15503:x1870604319948288:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947672.228260:0:14179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947672.228273:0:14179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cbd825400/0x20c3e53e78bb2fc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb2fbc expref: -99 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947672.228294:0:14179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cbd825400/0x20c3e53e78bb2fc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb2fbc expref: 18 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947672.228316:0:14179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cbd825400/0x20c3e53e78bb2fc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2fbc expref: 18 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947672.228324:0:14179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cbd825400, rc 0) 00000100:00100000:1.0:1783947672.228357:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+18:15503:x1870604319948288:12345-0@lo:101:mount.lustre.0 Request processed in 110us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947672.228363:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783947672.228439:0:15503:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947672.228460:0:15503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319948288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947672.228472:0:15503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825200/0x20c3e53e78bb2fbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2fc3 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947672.228481:0:15503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825200/0x20c3e53e78bb2fbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb2fc3 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783947672.229286:0:15503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1783947672.234920:0:15503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783947672.235259:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1783947672.235319:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1783947672.235386:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1783947672.235395:0:15503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1783947672.235508:0:15503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319948416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947672.235583:0:15503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947672.235621:0:15503:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672540 going to sleep for 11 seconds 00000100:00100000:0.0:1783947672.235701:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319948416 00000100:00100000:0.0:1783947672.236838:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319948416 00000100:00100000:0.0:1783947672.236894:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783947672.236903:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+18:15503:x1870604319948416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947672.238476:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+18:15503:x1870604319948416:12345-0@lo:501:mount.lustre.0 Request processed in 1566us (2884us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947672.238488:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783947672.238548:0:15503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319948416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947672.238612:0:15503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319948544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947672.238662:0:15503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947672.238700:0:15503:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c86672540 going to sleep for 11 seconds 00000100:00100000:2.0:1783947672.238812:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319948544 00000100:00100000:2.0:1783947672.238818:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319948544 00000100:00100000:2.0:1783947672.238863:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783947672.238871:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+18:15503:x1870604319948544:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947672.239048:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+18:15503:x1870604319948544:12345-0@lo:503:mount.lustre.0 Request processed in 179us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947672.239055:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783947672.241371:0:15503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319948544:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783947672.245786:0:15503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783947672.245885:0:15503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319948672:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947672.245974:0:15503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947672.246024:0:15503:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c82f679c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947672.246837:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319948672 00000100:00100000:1.0:1783947672.246845:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319948672 00000100:00100000:1.0:1783947672.246890:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783947672.246901:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cc00ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+18:15503:x1870604319948672:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783947672.247119:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cc00ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+18:15503:x1870604319948672:12345-0@lo:502:mount.lustre.0 Request processed in 220us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947672.247136:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783947672.247664:0:15503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319948672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783947672.248388:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1783947672.248480:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1783947672.248529:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1783947672.248568:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1783947672.248625:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1783947672.248674:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1783947672.248784:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1783947672.248823:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1783947672.248865:0:15503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319948800:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947672.249004:0:15503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947672.249328:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319948800 00000100:00100000:1.0:1783947672.249335:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319948800 00000100:00100000:1.0:1783947672.249385:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783947672.249458:0:15503:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cbd6fd240 going to sleep for 11 seconds 00000100:00100000:1.0:1783947672.250704:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+18:15503:x1870604319948800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783947672.251777:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+18:15503:x1870604319948800:12345-0@lo:502:mount.lustre.0 Request processed in 2381us (2769us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947672.251790:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783947672.253037:0:15503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319948800:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783947672.253216:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1783947672.253233:0:15503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1783947672.255081:0:15508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947672.255094:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947672.255096:0:15508:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783947672.255114:0:15508:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b3cb6185000 00000020:00000080:2.0:1783947672.255117:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783947672.255125:0:15508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947672.255128:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947672.255129:0:15508:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783947672.255132:0:15508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947672.255134:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947672.255136:0:15508:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783947672.255139:0:15508:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b3cb6185000 00000020:00000080:2.0:1783947672.255141:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783947672.255237:0:15508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947672.255240:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947672.255242:0:15508:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783947672.255244:0:15508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947672.255247:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947672.255248:0:15508:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783947672.255251:0:15508:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b3cb6185000 00000020:00000080:2.0:1783947672.255253:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783947672.256550:0:15508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947672.256559:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947672.256560:0:15508:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1783947672.256564:0:15508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1783947672.256841:0:15503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1783947672.256873:0:15503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783947672.256892:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825200/0x20c3e53e78bb2fbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2fc3 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.256905:0:15503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825200/0x20c3e53e78bb2fbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2fc3 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947672.257119:0:15503:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783947672.257122:0:15503:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b3cb6185000 10000000:01000000:0.0:1783947672.257126:0:15503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b3cb6185000 10000000:01000000:0.0:1783947672.257130:0:15503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783947672.257136:0:15503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b3cb6185000 from 1 10000000:01000000:0.0:1783947672.257139:0:15503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783947672.257826:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85670800/0x20c3e53e78bb2fca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.257837:0:15503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3c85670800/0x20c3e53e78bb2fca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.257849:0:15503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3c85670800/0x20c3e53e78bb2fca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947672.257874:0:15503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319948928:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783947672.258012:0:15503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947672.258121:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319948928 00000100:00100000:0.0:1783947672.258128:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319948928 00000100:00100000:0.0:1783947672.258352:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783947672.258362:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+18:15503:x1870604319948928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947672.258376:0:14177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947672.258392:0:14177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c85671000/0x20c3e53e78bb2fd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb2fca expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.258446:0:14177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c85671000/0x20c3e53e78bb2fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb2fca expref: 19 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.258457:0:14177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c85671000/0x20c3e53e78bb2fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2fca expref: 19 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.258465:0:14177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671000, rc 0) 00000100:00100000:0.0:1783947672.258502:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+19:15503:x1870604319948928:12345-0@lo:101:mount.lustre.0 Request processed in 143us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947672.258509:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783947672.258555:0:15503:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cbd6fd780 going to sleep for 11 seconds 00000100:00100000:0.0:1783947672.258576:0:15503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319948928:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947672.258591:0:15503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3c85670800/0x20c3e53e78bb2fca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2fd1 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.258600:0:15503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3c85670800/0x20c3e53e78bb2fca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb2fd1 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783947672.260656:0:15503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1783947672.262365:0:15503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783947672.262756:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1783947672.262805:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1783947672.262838:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1783947672.262899:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1783947672.262933:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1783947672.262978:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1783947672.263016:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1783947672.263048:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1783947672.263092:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1783947672.263126:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1783947672.263158:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1783947672.263904:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1783947672.264042:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1783947672.264078:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1783947672.264127:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1783947672.264288:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1783947672.264325:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1783947672.264374:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1783947672.264453:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1783947672.264514:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1783947672.264564:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1783947672.264601:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1783947672.264648:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1783947672.264696:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1783947672.264855:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1783947672.264890:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1783947672.265012:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1783947672.265049:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1783947672.265080:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1783947672.265126:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1783947672.265285:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1783947672.265324:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1783947672.265362:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1783947672.265517:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1783947672.265557:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1783947672.265623:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1783947672.265660:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1783947672.265829:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1783947672.265838:0:15503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1783947672.266016:0:15503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319949056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947672.266080:0:15503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947672.266121:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319949056 00000100:00100000:1.0:1783947672.266127:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319949056 00000100:00100000:1.0:1783947672.266296:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783947672.266306:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+19:15503:x1870604319949056:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947672.266559:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+19:15503:x1870604319949056:12345-0@lo:501:mount.lustre.0 Request processed in 255us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947672.266567:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783947672.266605:0:15503:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c882b0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947672.266625:0:15503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319949056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947672.266656:0:15503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319949184:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947672.266698:0:15503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947672.266796:0:15503:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c882b0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947672.267274:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319949184 00000100:00100000:0.0:1783947672.267279:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319949184 00000100:00100000:0.0:1783947672.267470:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783947672.267480:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+19:15503:x1870604319949184:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783947672.271114:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+19:15503:x1870604319949184:12345-0@lo:503:mount.lustre.0 Request processed in 3628us (4407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947672.271128:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783947672.271652:0:15503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319949184:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783947672.272190:0:15503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783947672.272275:0:15503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319949312:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783947672.272330:0:15503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947672.272372:0:15503:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c882b0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947672.272543:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319949312 00000100:00100000:0.0:1783947672.272550:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319949312 00000100:00100000:0.0:1783947672.272586:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783947672.272596:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+19:15503:x1870604319949312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947672.272797:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+19:15503:x1870604319949312:12345-0@lo:502:mount.lustre.0 Request processed in 202us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947672.272805:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783947672.273488:0:15503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319949312:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783947672.273733:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1783947672.273785:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1783947672.273822:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1783947672.273873:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1783947672.273909:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1783947672.273956:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1783947672.273993:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1783947672.274030:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1783947672.274082:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1783947672.274126:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1783947672.274156:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1783947672.274203:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1783947672.274239:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1783947672.274273:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1783947672.274656:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1783947672.274694:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1783947672.274726:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1783947672.274796:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1783947672.274833:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1783947672.274866:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1783947672.274911:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1783947672.274949:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1783947672.274996:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1783947672.275046:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1783947672.275086:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1783947672.275135:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1783947672.275183:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1783947672.276084:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1783947672.276125:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1783947672.276178:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1783947672.276228:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1783947672.276263:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1783947672.276298:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1783947672.276452:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1783947672.276494:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1783947672.276543:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1783947672.277695:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1783947672.277736:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1783947672.277786:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1783947672.277817:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1783947672.277860:0:15503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319949440:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947672.277926:0:15503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947672.277966:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319949440 00000100:00100000:0.0:1783947672.277972:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319949440 00000100:00100000:0.0:1783947672.278009:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783947672.278016:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+19:15503:x1870604319949440:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947672.278201:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+19:15503:x1870604319949440:12345-0@lo:502:mount.lustre.0 Request processed in 184us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947672.278209:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783947672.278265:0:15503:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c981c4000 going to sleep for 11 seconds 00000100:00100000:0.0:1783947672.278289:0:15503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319949440:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783947672.278755:0:15503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1783947672.278776:0:15503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1783947672.281810:0:15513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783947672.281827:0:15513:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8b3c85763380) 00000020:00000080:3.0:1783947672.281849:0:15513:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1783947672.282893:0:15513:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b3cb6185000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783947672.282899:0:15513:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b3cb6185000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783947672.282902:0:15513:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b3cb6185000 3 00010000:00080000:3.0:1783947672.283305:0:15513:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b3c84ca8800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.132@tcp at head 00010000:00010000:3.0:1783947672.286681:0:15513:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1783947672.287049:0:15513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783947672.287086:0:15513:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783947672.287100:0:15513:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x20c3e53e78bb2fdf 00000100:00080000:3.0:1783947672.287110:0:15513:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783947672.287116:0:15513:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b3c84ca8800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1783947672.287787:0:15513:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3b850d0380 x1870604319949568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947672.287812:0:15513:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783947672.287854:0:12650:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947672.287863:0:12650:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783947672.287865:0:12650:0:(import.c:65:import_set_state_nolock()) ffff8b3c8579e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783947672.287869:0:12650:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 485 00000100:00080000:3.0:1783947672.287873:0:12650:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783947672.287877:0:12650:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8b3c8579e000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1783947672.287890:0:12650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3b850d3800 x1870604319949824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783947672.288026:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319949696:0@lo:400:kworker.0 00000100:00100000:2.0:1783947672.288084:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947672.288120:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947672.288125:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319949952:0@lo:400:kworker.0 00000100:00100000:2.0:1783947672.288145:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947672.288290:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319950080:0@lo:400:kworker.0 00000100:00100000:0.0:1783947672.288441:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1870604319949568:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783947672.288448:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947672.288484:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319949696 00000100:00100000:0.0:1783947672.288490:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319949696 00000100:00100000:0.0:1783947672.288545:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947672.288551:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319949952 00000100:00100000:0.0:1783947672.288554:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1870604319949696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947672.288555:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319949952 00000100:00100000:3.0:1783947672.288578:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319950080 00000100:00100000:3.0:1783947672.288581:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319950080 00000100:00100000:3.0:1783947672.288597:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783947672.288603:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319949952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947672.288649:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319949952:12345-0@lo:400:kworker.0 Request processed in 46us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947672.288657:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783947672.288671:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783947672.288676:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319950080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947672.288704:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319950080:12345-0@lo:400:kworker.0 Request processed in 28us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947672.288723:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1783947672.288834:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3b850d3b80 x1870604319950080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947672.288848:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319950080:0@lo:400:kworker.0 00010000:00080000:2.0:1783947672.288885:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3b850d2680 x1870604319949952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947672.288893:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319949952:0@lo:400:kworker.0 00000100:00100000:0.0:1783947672.289239:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1870604319949696:12345-0@lo:400:kworker.0 Request processed in 686us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947672.289247:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1783947672.289264:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947672.289269:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947672.289285:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947672.289442:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319949824:0@lo:8:kworker.0 00000100:00100000:0.0:1783947672.289468:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947672.289491:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319949568 00000100:00100000:0.0:1783947672.289494:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319949568 00000100:00100000:0.0:1783947672.289513:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947672.289517:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1870604319949568:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783947672.289535:0:14185:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:0.0:1783947672.289575:0:14185:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x20c3e53e78bb2fe6 00000004:00100000:0.0:1783947672.289588:0:14185:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783947672.289613:0:14185:0:(import.c:65:import_set_state_nolock()) ffff8b3b84109800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947672.289645:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1870604319949568:12345-0@lo:38:llog_process_th.0 Request processed in 127us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947672.289651:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947672.289666:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319949824 00000100:00100000:0.0:1783947672.289669:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319949824 00000100:00100000:0.0:1783947672.289689:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783947672.289693:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1870604319949824:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1783947672.289725:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1870604319949824:12345-0@lo:8:kworker.0 Request processed in 30us (255us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783947672.289731:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1783947672.289864:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b3b850d0380 x1870604319949568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947672.289873:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783947672.289879:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1783947672.289885:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783947672.289889:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783947672.289891:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3c84ca8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783947672.289896:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1870604319949568:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783947672.289903:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783947672.289906:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3c8579e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783947672.289909:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783947672.289912:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319949824:0@lo:8:kworker.0 00000040:00080000:0.0:1783947672.291270:0:15513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1783947672.291446:0:15503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1783947672.291472:0:15503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783947672.291490:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85670800/0x20c3e53e78bb2fca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2fd1 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947672.291509:0:15503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c85670800/0x20c3e53e78bb2fca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2fd1 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783947672.291547:0:15503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783947672.291549:0:15503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783947672.291550:0:15503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783947672.291551:0:15503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947672.291553:0:15503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947672.291554:0:15503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947672.291555:0:15503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783947672.291557:0:15503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947672.291558:0:15503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783947672.291562:0:15503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1783947672.291564:0:15503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783947672.291566:0:15503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783947672.291567:0:15503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783947672.291568:0:15503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947672.291569:0:15503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947672.291570:0:15503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947672.291571:0:15503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783947672.291572:0:15503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947672.291573:0:15503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783947672.291605:0:15503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783947672.291623:0:15503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319950208:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783947672.291679:0:15503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947672.291752:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319950208 00000100:00100000:1.0:1783947672.291759:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319950208 00000100:00100000:3.0:1783947672.291787:0:15503:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb63d4300 going to sleep for 11 seconds 00000100:00100000:1.0:1783947672.291798:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783947672.291806:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+19:15503:x1870604319950208:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783947672.291830:0:14179:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1783947672.291842:0:14179:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1783947672.292492:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319949696:0@lo:400:kworker.0 20000000:01000000:0.0:1783947672.324863:0:14179:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783947672.324884:0:14179:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1783947672.324943:0:14200:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783947672.324948:0:14200:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783947672.324970:0:14200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b3cc0631600/0x20c3e53e78bb2fed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947672.324989:0:14200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb2ec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2eb9 expref: 19 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947672.324998:0:14200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b3cc0631600/0x20c3e53e78bb2fed lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947672.325037:0:14200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb2ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb2eb9 expref: 19 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947672.325049:0:14200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb2ec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb2eb9 expref: 19 pid: 14178 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947672.325063:0:14200:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb6aedc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14200:1870604319950336:0@lo:104: 00000100:00100000:2.0:1783947672.325120:0:14200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947672.325165:0:14200:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85cd23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947672.325795:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319950336 00000100:00100000:0.0:1783947672.325804:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319950336 00000100:00100000:0.0:1783947672.325851:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947672.325860:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9e11f6c7-2161-442e-ac38-f4342317f92b+3:14200:x1870604319950336:12345-0@lo:104: 00010000:00010000:0.0:1783947672.325874:0:14167:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb2ec0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.325947:0:14167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783947672.325953:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9e11f6c7-2161-442e-ac38-f4342317f92b+3:14200:x1870604319950336:12345-0@lo:104: Request processed in 94us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947672.325960:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1783947672.325980:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947672.325986:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb2ec0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.325994:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630200 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:0.0:1783947672.325998:0:14173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb2ec0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.326006:0:14173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2eb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb2ec0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947672.326013:0:14173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2eb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb2ec0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947672.326018:0:14173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783947672.326047:0:14173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2eb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2ec0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.326054:0:14173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783947672.326074:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2eb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2ec0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.326144:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cc0630200/0x20c3e53e78bb2eb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2ec0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.326172:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947672.326173:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947672.326175:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947672.326193:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9e11f6c7-2161-442e-ac38-f4342317f92b:3312:1870604319950464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947672.326285:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947672.326395:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319950464 00000100:00100000:0.0:1783947672.326399:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319950464 00010000:00010000:0.0:1783947672.326466:0:14171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb2ec0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb2eb9 expref: 20 pid: 14178 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947672.326488:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947672.326495:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e11f6c7-2161-442e-ac38-f4342317f92b+20:3312:x1870604319950464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947672.326505:0:14171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947672.326511:0:14171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb2ec0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb2eb9 expref: 20 pid: 14178 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.326520:0:14171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb2ec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb2eb9 expref: 20 pid: 14178 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.326535:0:14171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b3cc0631600/0x20c3e53e78bb2fed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.326543:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cc0631600/0x20c3e53e78bb2fed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783947672.326556:0:14171:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005361290s 00010000:00010000:0.0:1783947672.326781:0:14171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3cc0631600/0x20c3e53e78bb2fed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.326801:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3cc0631600/0x20c3e53e78bb2fed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.326808:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b3cc0631600/0x20c3e53e78bb2fed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.326813:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b3cc0631600/0x20c3e53e78bb2fed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.326818:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631600 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947672.326822:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b3cc0631600/0x20c3e53e78bb2fed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.326829:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b3cc0631600/0x20c3e53e78bb2fed lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.326838:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b3cc0631600/0x20c3e53e78bb2fed lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.326847:0:14171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947672.326879:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e11f6c7-2161-442e-ac38-f4342317f92b+20:3312:x1870604319950464:12345-0@lo:103:ldlm_bl.0 Request processed in 385us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947672.326887:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947672.326924:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9e11f6c7-2161-442e-ac38-f4342317f92b:3312:1870604319950464:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947672.326954:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb2ec0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb2eb9 expref: 19 pid: 14178 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947672.326966:0:14200:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb6aedc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14200:1870604319950336:0@lo:104: 00010000:00010000:0.0:1783947672.326979:0:14200:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b3cc0631600/0x20c3e53e78bb2fed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.326994:0:14200:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b3cc0631600/0x20c3e53e78bb2fed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.327000:0:14200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b3cc0631600/0x20c3e53e78bb2fed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947672.327006:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cc0631600/0x20c3e53e78bb2fed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947672.336385:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+18:15503:x1870604319950208:12345-0@lo:253:mount.lustre.0 Request processed in 44571us (44697us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947672.336388:0:15503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9e11f6c7-2161-442e-ac38-f4342317f92b:15503:1870604319950208:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783947672.336399:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 10000000:01000000:3.0:1783947672.336412:0:15503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783947672.336415:0:15503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783947672.336626:0:15503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783947672.336628:0:15503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783947672.336645:0:15503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947672.336647:0:15503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947672.336648:0:15503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947672.336650:0:15503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783947672.336652:0:15503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947672.336653:0:15503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783947672.336670:0:15503:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783947672.346635:0:15503:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1783947672.346812:0:15503:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1783947672.346972:0:15503:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1783947672.347123:0:15503:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783947672.347926:0:15503:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1783947672.348199:0:15503:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783947672.349512:0:15503:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1783947672.401895:0:15503:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1783947672.401903:0:15503:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1783947672.401936:0:15503:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783947672.402002:0:15503:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.132@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783947672.402017:0:15503:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1783947672.402042:0:15503:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1783947672.506806:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947673.530088:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783947673.593487:0:14182:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783947673.593495:0:14182:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8b3cbd9ce000 from 8 10000000:01000000:0.0:1783947673.593500:0:14182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783947673.593552:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85670600/0x20c3e53e78bb2ff4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947673.593564:0:14182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3c85670600/0x20c3e53e78bb2ff4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947673.593576:0:14182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3c85670600/0x20c3e53e78bb2ff4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947673.593604:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319950592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783947673.593679:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947673.593848:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c83610cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947673.594531:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319950592 00000100:00100000:2.0:1783947673.594542:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319950592 00000100:00100000:0.0:1783947673.594984:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783947673.594997:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+18:14182:x1870604319950592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947673.595016:0:14178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947673.595032:0:14178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c85670200/0x20c3e53e78bb2ffb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb2ff4 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947673.595059:0:14178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c85670200/0x20c3e53e78bb2ffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb2ff4 expref: 19 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947673.595070:0:14178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c85670200/0x20c3e53e78bb2ffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2ff4 expref: 19 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947673.595081:0:14178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670200, rc 0) 00000100:00100000:0.0:1783947673.595339:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+19:14182:x1870604319950592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 344us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947673.595457:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783947673.600726:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319950592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947673.600754:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3c85670600/0x20c3e53e78bb2ff4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2ffb expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947673.600780:0:14182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3c85670600/0x20c3e53e78bb2ff4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb2ffb expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947673.601679:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319950720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783947673.601745:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947673.601970:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319950720 00000100:00100000:2.0:1783947673.601977:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319950720 00000100:00100000:2.0:1783947673.602047:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783947673.602055:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+19:14182:x1870604319950720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783947673.602075:0:14179:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783947673.602090:0:14179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783947673.602092:0:14179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1783947673.603008:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c836100c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947673.612298:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+19:14182:x1870604319950720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 10233us (10541us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947673.612313:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783947673.612769:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319950720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783947673.613035:0:14182:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783947673.613045:0:14182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3c85670600/0x20c3e53e78bb2ff4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2ffb expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947673.613057:0:14182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3c85670600/0x20c3e53e78bb2ff4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb2ffb expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783947673.792715:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1783947673.793157:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1783947674.556981:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947675.194202:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947675.194224:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319950848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947675.194287:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947675.194666:0:14823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319950848 00000100:00100000:0.0:1783947675.194674:0:14823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319950848 00000100:00100000:0.0:1783947675.194728:0:14823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947675.194737:0:14823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319950848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947675.194780:0:14823:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947675.194834:0:14823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319950848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947675.194842:0:14823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947675.194862:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00080000:0.0:1783947675.194867:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947675.194889:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319950848:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783947675.578184:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947676.605913:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947677.635262:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783947677.789261:0:12650:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783947677.789268:0:12650:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783947677.789271:0:12650:0:(import.c:65:import_set_state_nolock()) ffff8b3c8579e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783947677.789284:0:12650:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8b3c8579e000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1783947677.789306:0:12650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b3cb60a3100 x1870604319951232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783947677.789376:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319951488:0@lo:400:kworker.0 00000100:00100000:1.0:1783947677.789475:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947677.789561:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783947677.789568:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9e11f6c7-2161-442e-ac38-f4342317f92b:3313:1870604319950976:0@lo:400:kworker.0 00000100:00100000:1.0:1783947677.789601:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947677.789625:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319951616:0@lo:400:kworker.0 00000100:00100000:1.0:1783947677.789652:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947677.789678:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319951104:0@lo:400:kworker.0 00000100:00100000:1.0:1783947677.789703:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947677.789737:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947677.789742:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319951360:0@lo:400:kworker.0 00000100:00100000:1.0:1783947677.789762:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947677.789787:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319951232:0@lo:8:kworker.0 00000100:00100000:1.0:1783947677.789812:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947677.789843:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319951488 00000100:00100000:1.0:1783947677.789851:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319951488 00000100:00100000:1.0:1783947677.790135:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319951616 00000100:00100000:1.0:1783947677.790140:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319951616 00000100:00100000:1.0:1783947677.790164:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319951360 00000100:00100000:1.0:1783947677.790167:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319951360 00000100:00100000:1.0:1783947677.790182:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783947677.790190:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319951488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947677.790245:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870604319951488:12345-0@lo:400:kworker.0 Request processed in 56us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947677.790252:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783947677.790266:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783947677.790272:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319951616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947677.790294:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319951616:12345-0@lo:400:kworker.0 Request processed in 22us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947677.790311:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783947677.790324:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783947677.790329:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319951360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947677.790363:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319951360:12345-0@lo:400:kworker.0 Request processed in 33us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947677.790404:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783947677.790448:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319950976 00000100:00100000:1.0:1783947677.790453:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319950976 00000100:00100000:1.0:1783947677.790490:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783947677.790497:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+19:3313:x1870604319950976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947677.790630:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+19:3313:x1870604319950976:12345-0@lo:400:kworker.0 Request processed in 133us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947677.790637:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783947677.790669:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319951104 00000100:00100000:1.0:1783947677.790673:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319951104 00000100:00100000:1.0:1783947677.790696:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319951232 00000100:00100000:1.0:1783947677.790699:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319951232 00000100:00100000:1.0:1783947677.790965:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947677.790973:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319951104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947677.791009:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319951104:12345-0@lo:400:kworker.0 Request processed in 38us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947677.791015:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947677.791028:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783947677.791032:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1870604319951232:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783947677.791056:0:14822:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:1.0:1783947677.791096:0:14822:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20c3e53e78bb3002 00002000:00100000:1.0:1783947677.791119:0:14822:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8b3c8518d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1783947677.791123:0:14822:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1783947677.791126:0:14822:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783947677.792789:0:14822:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783947677.792823:0:14822:0:(import.c:65:import_set_state_nolock()) ffff8b3c8518e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783947677.793277:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1870604319951232:12345-0@lo:8:kworker.0 Request processed in 2240us (3460us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947677.793288:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1783947677.793331:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947677.793337:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783947677.793385:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cb60a3100 x1870604319951232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783947702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783947677.793403:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1783947677.793413:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783947677.794034:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783947677.794039:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b3c8579e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783947677.794103:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783947677.794111:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1870604319951232:0@lo:8:kworker.0 00010000:00080000:1.0:1783947677.794170:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cb60a0a80 x1870604319951360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947677.794252:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319951360:0@lo:400:kworker.0 00000100:00100000:1.0:1783947677.794273:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319951104:0@lo:400:kworker.0 00000100:00100000:1.0:1783947677.794301:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9e11f6c7-2161-442e-ac38-f4342317f92b:3313:1870604319950976:0@lo:400:kworker.0 00010000:00080000:1.0:1783947677.794313:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cb60a0380 x1870604319951616/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947677.794342:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319951616:0@lo:400:kworker.0 00010000:00080000:1.0:1783947677.794357:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cb60a1180 x1870604319951488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947677.794373:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1870604319951488:0@lo:400:kworker.0 00000004:00080000:2.0:1783947677.797515:0:14208:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783947677.800109:0:14208:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 493070687773ns, next at 0ns, rc = 0 00000004:00080000:3.0:1783947677.810491:0:14209:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1783947677.810516:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14209:1870604319951872:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783947677.810580:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947677.810604:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3b8432fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1783947677.810810:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319951744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947677.810841:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947677.810891:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319951872 00000100:00100000:1.0:1783947677.810898:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319951872 00000100:00100000:1.0:1783947677.810956:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783947677.810965:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14209:x1870604319951872:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783947677.812237:0:14823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319951744 00000100:00100000:0.0:1783947677.812247:0:14823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319951744 00000100:00100000:0.0:1783947677.812291:0:14823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947677.812300:0:14823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1870604319951744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783947677.812331:0:14823:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947677.812400:0:14823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1870604319951744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947677.812408:0:14823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1783947677.813836:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783947677.815607:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3b850d2a00 x1870604319951744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947677.815636:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319951744:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1783947677.824616:0:14822:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1783947677.824627:0:14822:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1783947677.824632:0:14822:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1783947677.842057:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.842070:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb3009 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.842086:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.842091:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.842097:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb3009 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.842115:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb3009 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.842139:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb3009 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.842147:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb3009 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.842305:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947677.842320:0:15408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947677.842326:0:15408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb3009 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.842334:0:15408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd824a00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947677.842338:0:15408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb3009 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.842348:0:15408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb3009 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.842374:0:15408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb3009 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.842383:0:15408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb3009 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.842400:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.842409:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.842412:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783947677.844513:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.845537:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3010 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.845554:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.845559:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.845566:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3010 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.845658:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3010 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.845669:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3010 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.845676:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3010 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.845728:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947677.846411:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947677.846445:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3010 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783947677.846445:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.846451:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb3017 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947677.846454:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd824600 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947677.846459:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3010 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.846460:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.846464:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.846468:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb3017 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947677.846470:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3010 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.846484:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb3017 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947677.846489:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3010 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.846493:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb3017 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947677.846497:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3010 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.846501:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb3017 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947677.846515:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947677.846517:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783947677.846613:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947677.846637:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb3017 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947677.846644:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd825000 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947677.846648:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb3017 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947677.846667:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb3017 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947677.846677:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb3017 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947677.846684:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb3017 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947677.846697:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947677.846699:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947677.846701:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783947677.850920:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.850931:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb301e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.850948:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.850952:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.850959:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb301e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.850972:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb301e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.850984:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb301e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.851002:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb301e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.851019:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947677.851032:0:15408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947677.851038:0:15408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb301e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.851045:0:15408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd824a00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947677.851049:0:15408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb301e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.851059:0:15408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb301e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.851076:0:15408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb301e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.851084:0:15408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eba6e8de/0x20c3e53e78bb301e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.851099:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.851101:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.851102:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783947677.853413:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.853452:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf6b56f6/0x20c3e53e78bb3025 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.853468:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.853472:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.853478:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf6b56f6/0x20c3e53e78bb3025 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.853490:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf6b56f6/0x20c3e53e78bb3025 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.853501:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf6b56f6/0x20c3e53e78bb3025 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.853509:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf6b56f6/0x20c3e53e78bb3025 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.853526:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947677.853539:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947677.853544:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf6b56f6/0x20c3e53e78bb3025 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.853551:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd825e00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947677.853556:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf6b56f6/0x20c3e53e78bb3025 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.853565:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf6b56f6/0x20c3e53e78bb3025 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.853587:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf6b56f6/0x20c3e53e78bb3025 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.853595:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf6b56f6/0x20c3e53e78bb3025 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.853614:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.853616:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.853618:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783947677.854515:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.854523:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084dbf8e8/0x20c3e53e78bb302c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.854533:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.854537:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.854541:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084dbf8e8/0x20c3e53e78bb302c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.854550:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084dbf8e8/0x20c3e53e78bb302c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.854558:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084dbf8e8/0x20c3e53e78bb302c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.854564:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084dbf8e8/0x20c3e53e78bb302c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.854588:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947677.854596:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947677.854601:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084dbf8e8/0x20c3e53e78bb302c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.854607:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd825c00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947677.854611:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084dbf8e8/0x20c3e53e78bb302c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.854618:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084dbf8e8/0x20c3e53e78bb302c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.854629:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084dbf8e8/0x20c3e53e78bb302c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.854636:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084dbf8e8/0x20c3e53e78bb302c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.854649:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.854650:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.854652:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783947677.855638:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.855646:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7ce3042/0x20c3e53e78bb3033 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.855658:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.855669:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.855674:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ce3042/0x20c3e53e78bb3033 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.855686:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7ce3042/0x20c3e53e78bb3033 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.855695:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7ce3042/0x20c3e53e78bb3033 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.855702:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ce3042/0x20c3e53e78bb3033 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.855717:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947677.855728:0:15408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947677.855732:0:15408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7ce3042/0x20c3e53e78bb3033 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.855739:0:15408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd825800 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947677.855742:0:15408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7ce3042/0x20c3e53e78bb3033 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.855750:0:15408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7ce3042/0x20c3e53e78bb3033 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.855764:0:15408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7ce3042/0x20c3e53e78bb3033 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.855949:0:15408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7ce3042/0x20c3e53e78bb3033 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.855965:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.855968:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.855970:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783947677.856639:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.856647:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079c72bfc/0x20c3e53e78bb303a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.856656:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.856659:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.856663:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079c72bfc/0x20c3e53e78bb303a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.856672:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079c72bfc/0x20c3e53e78bb303a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.856679:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079c72bfc/0x20c3e53e78bb303a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.856686:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079c72bfc/0x20c3e53e78bb303a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.856699:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947677.856728:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947677.856735:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079c72bfc/0x20c3e53e78bb303a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.856742:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd824e00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947677.856751:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079c72bfc/0x20c3e53e78bb303a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.856759:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079c72bfc/0x20c3e53e78bb303a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.856773:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079c72bfc/0x20c3e53e78bb303a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.856781:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079c72bfc/0x20c3e53e78bb303a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.856797:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.856799:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.856800:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783947677.858459:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.858475:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e047bbb4/0x20c3e53e78bb3041 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.858490:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.858494:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.858500:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e047bbb4/0x20c3e53e78bb3041 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.858513:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e047bbb4/0x20c3e53e78bb3041 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.858523:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e047bbb4/0x20c3e53e78bb3041 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.858531:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e047bbb4/0x20c3e53e78bb3041 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.858548:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947677.858560:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947677.858566:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e047bbb4/0x20c3e53e78bb3041 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.858574:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd824000 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947677.858579:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e047bbb4/0x20c3e53e78bb3041 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.858587:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e047bbb4/0x20c3e53e78bb3041 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.858608:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e047bbb4/0x20c3e53e78bb3041 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.858616:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e047bbb4/0x20c3e53e78bb3041 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.858633:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.858635:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.858637:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783947677.859362:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.859379:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001af90ef/0x20c3e53e78bb3048 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.859390:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.859394:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.859399:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001af90ef/0x20c3e53e78bb3048 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.859408:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001af90ef/0x20c3e53e78bb3048 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.859416:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001af90ef/0x20c3e53e78bb3048 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.859442:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001af90ef/0x20c3e53e78bb3048 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.859468:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947677.859478:0:15408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947677.859483:0:15408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001af90ef/0x20c3e53e78bb3048 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.859491:0:15408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd824c00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947677.859494:0:15408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001af90ef/0x20c3e53e78bb3048 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.859502:0:15408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001af90ef/0x20c3e53e78bb3048 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.859515:0:15408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001af90ef/0x20c3e53e78bb3048 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.859522:0:15408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001af90ef/0x20c3e53e78bb3048 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.859536:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.859537:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.859539:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783947677.860105:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.860111:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c99c23f0/0x20c3e53e78bb304f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.860121:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.860263:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.860269:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c99c23f0/0x20c3e53e78bb304f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.860280:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c99c23f0/0x20c3e53e78bb304f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.860289:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c99c23f0/0x20c3e53e78bb304f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.860297:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c99c23f0/0x20c3e53e78bb304f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.860316:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783947677.860729:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.860736:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c1e339c/0x20c3e53e78bb3056 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.860745:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.860748:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.860751:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c1e339c/0x20c3e53e78bb3056 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.860761:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c1e339c/0x20c3e53e78bb3056 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.860769:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c1e339c/0x20c3e53e78bb3056 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.860810:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947677.860817:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c99c23f0/0x20c3e53e78bb304f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.860825:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd824800 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947677.860829:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c99c23f0/0x20c3e53e78bb304f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.860838:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c99c23f0/0x20c3e53e78bb304f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.860852:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c99c23f0/0x20c3e53e78bb304f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.860866:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c99c23f0/0x20c3e53e78bb304f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.860885:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.860887:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.860888:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.860936:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c1e339c/0x20c3e53e78bb3056 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.860952:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947677.860958:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947677.860963:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c1e339c/0x20c3e53e78bb3056 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.860971:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd824400 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947677.860974:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c1e339c/0x20c3e53e78bb3056 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.860982:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c1e339c/0x20c3e53e78bb3056 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.860993:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c1e339c/0x20c3e53e78bb3056 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.861000:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c1e339c/0x20c3e53e78bb3056 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.861013:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.861015:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.861016:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783947677.861490:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.861496:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb305d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.861504:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.861507:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.861511:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb305d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.861520:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb305d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.861529:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb305d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.861536:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb305d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.861553:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947677.861687:0:15408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947677.861693:0:15408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb305d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.861701:0:15408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd825000 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947677.861704:0:15408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb305d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.861723:0:15408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb305d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.861735:0:15408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb305d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.861742:0:15408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031dea1bb/0x20c3e53e78bb305d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.861757:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.861758:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.861760:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783947677.862388:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.862396:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3064 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.862412:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.862415:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.862439:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3064 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.862450:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3064 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.862459:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3064 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.862466:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3064 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.862478:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947677.862949:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947677.862956:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3064 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.862966:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd824600 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947677.862970:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3064 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.862989:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3064 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.863004:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3064 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.863011:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003ad60d5/0x20c3e53e78bb3064 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783947677.863022:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.863028:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb306b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.863029:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.863031:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.863033:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.863036:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.863039:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.863043:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb306b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.863052:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb306b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.863071:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb306b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.863078:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb306b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.863099:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947677.863609:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947677.863615:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb306b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.863624:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a000 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947677.863628:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb306b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.863635:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb306b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783947677.863639:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.863644:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfb75a85/0x20c3e53e78bb3072 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.863647:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb306b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.863652:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.863655:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.863660:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfb75a85/0x20c3e53e78bb3072 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.863666:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb306b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.863669:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfb75a85/0x20c3e53e78bb3072 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.863677:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfb75a85/0x20c3e53e78bb3072 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.863680:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.863681:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.863683:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.863684:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfb75a85/0x20c3e53e78bb3072 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.863708:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947677.863717:0:15408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947677.863721:0:15408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfb75a85/0x20c3e53e78bb3072 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.863728:0:15408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b800 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947677.863731:0:15408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfb75a85/0x20c3e53e78bb3072 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.863739:0:15408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfb75a85/0x20c3e53e78bb3072 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.863749:0:15408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfb75a85/0x20c3e53e78bb3072 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.863756:0:15408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfb75a85/0x20c3e53e78bb3072 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.863770:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.863928:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.863930:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783947677.864717:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.864726:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eabefd9d/0x20c3e53e78bb3079 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.864736:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.864746:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.864751:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eabefd9d/0x20c3e53e78bb3079 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.864762:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eabefd9d/0x20c3e53e78bb3079 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.864927:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eabefd9d/0x20c3e53e78bb3079 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.864938:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eabefd9d/0x20c3e53e78bb3079 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.864950:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947677.865121:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947677.865127:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eabefd9d/0x20c3e53e78bb3079 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.865135:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73aa00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947677.865139:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eabefd9d/0x20c3e53e78bb3079 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.865148:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eabefd9d/0x20c3e53e78bb3079 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.865380:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eabefd9d/0x20c3e53e78bb3079 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.865388:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eabefd9d/0x20c3e53e78bb3079 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.865406:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.865408:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.865410:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783947677.865812:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.865818:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb3080 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.865828:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.865832:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.865837:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb3080 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.865847:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb3080 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.865856:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb3080 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.866051:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb3080 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.866071:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947677.866481:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947677.866488:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb3080 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.866496:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73ac00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947677.866500:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb3080 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.866508:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb3080 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.866529:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb3080 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.866537:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb3080 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.866553:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.866554:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.866556:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783947677.866717:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.866723:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f223854b/0x20c3e53e78bb3087 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.866731:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.866734:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.866738:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f223854b/0x20c3e53e78bb3087 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.866748:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f223854b/0x20c3e53e78bb3087 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.866757:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f223854b/0x20c3e53e78bb3087 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.866765:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f223854b/0x20c3e53e78bb3087 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783947677.867483:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1783947677.867791:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947677.867825:0:15408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947677.867832:0:15408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f223854b/0x20c3e53e78bb3087 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.867841:0:15408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b200 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947677.867845:0:15408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f223854b/0x20c3e53e78bb3087 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.867865:0:15408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f223854b/0x20c3e53e78bb3087 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.867879:0:15408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f223854b/0x20c3e53e78bb3087 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.867886:0:15408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f223854b/0x20c3e53e78bb3087 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.867904:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.867906:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.867908:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783947677.869047:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.869057:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb308e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.869076:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.869080:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.869086:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb308e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.869098:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb308e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.869108:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb308e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.869116:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb308e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.869136:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783947677.869584:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.869590:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001196625f/0x20c3e53e78bb3095 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.869599:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.869602:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.869607:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001196625f/0x20c3e53e78bb3095 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.869616:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001196625f/0x20c3e53e78bb3095 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.869633:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001196625f/0x20c3e53e78bb3095 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.869641:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001196625f/0x20c3e53e78bb3095 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.869659:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783947677.870020:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.870026:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb8bca16/0x20c3e53e78bb309c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870035:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.870038:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.870043:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb8bca16/0x20c3e53e78bb309c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870052:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb8bca16/0x20c3e53e78bb309c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870060:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb8bca16/0x20c3e53e78bb309c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870067:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb8bca16/0x20c3e53e78bb309c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870091:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783947677.870104:0:15408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783947677.870110:0:15408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb308e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870117:0:15408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a200 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947677.870122:0:15408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb308e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870131:0:15408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb308e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870146:0:15408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb308e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870153:0:15408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb308e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870172:0:15408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947677.870176:0:15408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001196625f/0x20c3e53e78bb3095 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870182:0:15408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73ae00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947677.870186:0:15408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001196625f/0x20c3e53e78bb3095 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870205:0:15408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001196625f/0x20c3e53e78bb3095 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870215:0:15408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001196625f/0x20c3e53e78bb3095 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870222:0:15408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001196625f/0x20c3e53e78bb3095 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870235:0:15408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947677.870239:0:15408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb8bca16/0x20c3e53e78bb309c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870246:0:15408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73ba00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947677.870249:0:15408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb8bca16/0x20c3e53e78bb309c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870255:0:15408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb8bca16/0x20c3e53e78bb309c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870264:0:15408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb8bca16/0x20c3e53e78bb309c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870271:0:15408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb8bca16/0x20c3e53e78bb309c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870293:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.870294:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.870296:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783947677.870741:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.870747:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aab1d59c/0x20c3e53e78bb30a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870755:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.870759:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.870763:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aab1d59c/0x20c3e53e78bb30a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870771:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aab1d59c/0x20c3e53e78bb30a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870779:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aab1d59c/0x20c3e53e78bb30a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870785:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aab1d59c/0x20c3e53e78bb30a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870799:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947677.870807:0:15408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947677.870811:0:15408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aab1d59c/0x20c3e53e78bb30a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870828:0:15408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b000 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947677.870831:0:15408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aab1d59c/0x20c3e53e78bb30a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870839:0:15408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aab1d59c/0x20c3e53e78bb30a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870850:0:15408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aab1d59c/0x20c3e53e78bb30a3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870857:0:15408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aab1d59c/0x20c3e53e78bb30a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.870870:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.870872:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.870874:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783947677.871251:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783947677.871257:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb30aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.871265:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1783947677.871268:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947677.871272:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb30aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.871281:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb30aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.871296:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb30aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.871303:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb30aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.871316:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947677.871324:0:15408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947677.871328:0:15408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb30aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.871334:0:15408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b600 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947677.871338:0:15408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb30aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.871345:0:15408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb30aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.871355:0:15408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb30aa lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.871362:0:15408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb30aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.872195:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947677.872326:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783947677.874597:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783947677.874609:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d590d4/0x20c3e53e78bb30b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.874626:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1783947677.874630:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947677.874636:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048d590d4/0x20c3e53e78bb30b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.874649:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048d590d4/0x20c3e53e78bb30b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.874660:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d590d4/0x20c3e53e78bb30b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.874675:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048d590d4/0x20c3e53e78bb30b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.874697:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947677.874764:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947677.874770:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048d590d4/0x20c3e53e78bb30b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.874779:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671200 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947677.874784:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d590d4/0x20c3e53e78bb30b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.874794:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d590d4/0x20c3e53e78bb30b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.874811:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048d590d4/0x20c3e53e78bb30b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.874820:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048d590d4/0x20c3e53e78bb30b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.874837:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.874839:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.874841:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783947677.877818:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783947677.877837:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a17cc7d/0x20c3e53e78bb30b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.877853:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1783947677.877858:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947677.877863:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a17cc7d/0x20c3e53e78bb30b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.877878:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a17cc7d/0x20c3e53e78bb30b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.877888:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a17cc7d/0x20c3e53e78bb30b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.877895:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a17cc7d/0x20c3e53e78bb30b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.878041:0:15408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947677.878052:0:15408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a17cc7d/0x20c3e53e78bb30b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.878059:0:15408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671600 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947677.878064:0:15408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a17cc7d/0x20c3e53e78bb30b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.878074:0:15408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a17cc7d/0x20c3e53e78bb30b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.878090:0:15408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a17cc7d/0x20c3e53e78bb30b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.878098:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.878100:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.878119:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783947677.878124:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a17cc7d/0x20c3e53e78bb30b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783947677.878679:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783947677.878685:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd882edf/0x20c3e53e78bb30bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.878694:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1783947677.878697:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947677.878720:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd882edf/0x20c3e53e78bb30bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.878732:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd882edf/0x20c3e53e78bb30bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.878741:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd882edf/0x20c3e53e78bb30bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947677.878748:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd882edf/0x20c3e53e78bb30bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947677.880778:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947677.880794:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd882edf/0x20c3e53e78bb30bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947677.880808:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671400 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947677.880813:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd882edf/0x20c3e53e78bb30bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947677.880825:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd882edf/0x20c3e53e78bb30bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947677.880847:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd882edf/0x20c3e53e78bb30bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947677.880865:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947677.880867:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947677.880869:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947677.883810:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947677.885009:0:14822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783947677.885021:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd882edf/0x20c3e53e78bb30bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947677.885663:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1783947677.886700:0:14822:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1783947677.886792:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14209:x1870604319951872:12345-0@lo:5:osp-pre-1-0.0 Request processed in 75824us (76207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947677.886806:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783947677.886813:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14209:1870604319951872:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783947677.886828:0:14209:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1783947677.886873:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14209:1870604319952000:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783947677.886906:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947677.886952:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c857da240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947677.887263:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319952000 00000100:00100000:2.0:1783947677.887271:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319952000 00000100:00100000:2.0:1783947677.887312:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783947677.887320:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14209:x1870604319952000:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1783947677.887357:0:14821:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1783947677.896063:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14209:x1870604319952000:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8734us (9146us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1783947677.896079:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783947677.903467:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14209:1870604319952000:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783947677.903489:0:14209:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000040:00080000:0.0:1783947677.947826:0:14219:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783947678.650708:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947679.678683:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783947679.853858:0:15860:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1783947680.318262:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319952128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947680.318336:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947680.318659:0:14823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319952128 00000100:00100000:2.0:1783947680.318668:0:14823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319952128 00000100:00100000:2.0:1783947680.318731:0:14823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783947680.318740:0:14823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319952128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947680.318776:0:14823:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1783947680.318902:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947680.319016:0:14823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319952128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 277us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947680.319036:0:14823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947680.319094:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319952128:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783947680.699254:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947681.721599:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947682.479795:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947682.479892:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297937024 00000100:00100000:0.0:1783947682.479902:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297937024 00000100:00100000:0.0:1783947682.479951:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 75 00000100:00100000:0.0:1783947682.479960:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2352:x1870604297937024:12345-192.168.203.32@tcp:250:mount.lustre.0 00010000:00080000:0.0:1783947682.479990:0:14179:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from c6916452-685c-4987-9050-344ce2627597@192.168.203.32@tcp t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:0.0:1783947682.480033:0:14179:0:(genops.c:1406:class_connect()) connect: client c6916452-685c-4987-9050-344ce2627597, cookie 0x20c3e53e78bb30c6 00000100:00080000:0.0:1783947682.480166:0:14179:0:(import.c:65:import_set_state_nolock()) ffff8b3b8410f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947682.480251:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6916452-685c-4987-9050-344ce2627597+5:2352:x1870604297937024:12345-192.168.203.32@tcp:250:mount.lustre.0 Request processed in 290us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947682.480259:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 75 00000100:00100000:2.0:1783947682.497246:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947682.497351:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297937152 00000100:00100000:3.0:1783947682.497366:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297937152 00000100:00100000:3.0:1783947682.497453:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 76 00000100:00100000:3.0:1783947682.497462:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+5:13723:x1870604297937152:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783947682.497479:0:14177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947682.497494:0:14177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3ca9d1a800/0x20c3e53e78bb30cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab399 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947682.497519:0:14177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3ca9d1a800/0x20c3e53e78bb30cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab399 expref: 6 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947682.497530:0:14177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3ca9d1a800/0x20c3e53e78bb30cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab399 expref: 6 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947682.497550:0:14177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1a800, rc 0) 00000100:00100000:3.0:1783947682.497600:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+6:13723:x1870604297937152:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 139us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947682.497607:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 76 00000100:00100000:2.0:1783947682.502553:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947682.502664:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297937280 00000100:00100000:1.0:1783947682.502675:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297937280 00000100:00100000:1.0:1783947682.502727:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 77 00000100:00100000:1.0:1783947682.502737:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+6:13723:x1870604297937280:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783947682.503088:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+6:13723:x1870604297937280:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 351us (542us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783947682.503107:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 77 00000100:00100000:2.0:1783947682.505953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947682.506783:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297937408 00000100:00100000:0.0:1783947682.506847:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297937408 00000100:00100000:0.0:1783947682.506953:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 78 00000100:00100000:0.0:1783947682.506964:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6916452-685c-4987-9050-344ce2627597+6:13723:x1870604297937408:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783947682.506981:0:14179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947682.506997:0:14179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c85671200/0x20c3e53e78bb30d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab3a0 expref: -99 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947682.507026:0:14179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c85671200/0x20c3e53e78bb30d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab3a0 expref: 7 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947682.507038:0:14179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c85671200/0x20c3e53e78bb30d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab3a0 expref: 7 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947682.507047:0:14179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671200, rc 0) 00000100:00100000:0.0:1783947682.507101:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6916452-685c-4987-9050-344ce2627597+7:13723:x1870604297937408:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 139us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947682.507108:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 78 00000100:00100000:2.0:1783947682.509079:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947682.509152:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297937536 00000100:00100000:1.0:1783947682.509161:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297937536 00000100:00100000:1.0:1783947682.509247:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 79 00000100:00100000:1.0:1783947682.509256:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+7:13723:x1870604297937536:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783947682.509571:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+8:13723:x1870604297937536:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 315us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947682.509580:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 79 00000100:00100000:2.0:1783947682.513123:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947682.513208:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297937664 00000100:00100000:0.0:1783947682.513284:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297937664 00000100:00100000:0.0:1783947682.513350:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 80 00000100:00100000:0.0:1783947682.513359:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb7f96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6916452-685c-4987-9050-344ce2627597+8:13723:x1870604297937664:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783947682.514135:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb7f96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6916452-685c-4987-9050-344ce2627597+8:13723:x1870604297937664:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 774us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947682.514146:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 80 00000100:00100000:2.0:1783947682.523213:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947682.524936:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297937792 00000100:00100000:1.0:1783947682.524950:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297937792 00000100:00100000:1.0:1783947682.525042:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 81 00000100:00100000:1.0:1783947682.525053:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+8:13741:x1870604297937792:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783947682.525569:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+8:13741:x1870604297937792:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 517us (2363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947682.525578:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 81 00000100:00100000:2.0:1783947682.567319:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947682.567461:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297937920 00000100:00100000:3.0:1783947682.567470:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297937920 00000100:00100000:3.0:1783947682.567537:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 82 00000100:00100000:3.0:1783947682.567548:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+8:13741:x1870604297937920:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783947682.568167:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+8:13741:x1870604297937920:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 619us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947682.568175:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 82 00000100:00100000:2.0:1783947682.574666:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947682.575035:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297938048 00000100:00100000:1.0:1783947682.575045:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297938048 00000100:00100000:1.0:1783947682.575100:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 83 00000100:00100000:1.0:1783947682.575111:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+8:13723:x1870604297938048:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783947682.575128:0:14178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947682.575145:0:14178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cad73b000/0x20c3e53e78bb30db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab3ca expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947682.575172:0:14178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cad73b000/0x20c3e53e78bb30db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab3ca expref: 9 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947682.575202:0:14178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cad73b000/0x20c3e53e78bb30db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab3ca expref: 9 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947682.575212:0:14178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73b000, rc 0) 00000100:00100000:1.0:1783947682.575284:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+9:13723:x1870604297938048:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 174us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947682.575292:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 83 00000100:00100000:2.0:1783947682.578763:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947682.578974:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297938176 00000100:00100000:3.0:1783947682.578983:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297938176 00000100:00100000:3.0:1783947682.580220:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00100000:3.0:1783947682.580236:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+9:13723:x1870604297938176:12345-192.168.203.32@tcp:256:mount.lustre.0 20000000:01000000:3.0:1783947682.580261:0:14177:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783947682.580283:0:14177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783947682.580287:0:14177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783947682.580290:0:14177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783947682.580292:0:14177:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1783947682.590940:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+9:13723:x1870604297938176:12345-192.168.203.32@tcp:256:mount.lustre.0 Request processed in 10699us (12175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947682.590954:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00100000:2.0:1783947682.606179:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947682.606271:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297938304 00000100:00100000:0.0:1783947682.606280:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297938304 00000100:00100000:0.0:1783947682.606344:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 85 00000100:00100000:0.0:1783947682.606355:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6916452-685c-4987-9050-344ce2627597+9:13723:x1870604297938304:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783947682.606372:0:14179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947682.606390:0:14179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb30e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab3d1 expref: -99 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947682.606435:0:14179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb30e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab3d1 expref: 10 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947682.606448:0:14179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb30e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab3d1 expref: 10 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947682.606457:0:14179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671600, rc 0) 00000100:00100000:0.0:1783947682.606521:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6916452-685c-4987-9050-344ce2627597+10:13723:x1870604297938304:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 168us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947682.606537:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 85 00000100:00100000:2.0:1783947682.610191:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947682.610618:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297938432 00000100:00100000:3.0:1783947682.610628:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297938432 00000100:00100000:3.0:1783947682.610822:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 86 00000100:00100000:3.0:1783947682.610833:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+10:13723:x1870604297938432:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783947682.611123:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+10:13723:x1870604297938432:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 291us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947682.611131:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 86 00000100:00100000:3.0:1783947682.625349:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947682.626171:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297938560 00000100:00100000:1.0:1783947682.626181:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297938560 00000100:00100000:1.0:1783947682.626241:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 87 00000100:00100000:1.0:1783947682.626250:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+10:13723:x1870604297938560:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783947682.628410:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+10:13723:x1870604297938560:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 2149us (3069us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947682.628443:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 87 00000100:00100000:2.0:1783947682.637098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947682.637396:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297938688 00000100:00100000:3.0:1783947682.637406:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297938688 00000100:00100000:3.0:1783947682.637498:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:3.0:1783947682.637508:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+10:13745:x1870604297938688:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783947682.637821:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+10:13745:x1870604297938688:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 314us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947682.637830:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:3.0:1783947682.656297:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947682.657791:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297938816 00000100:00100000:1.0:1783947682.657815:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297938816 00000100:00100000:1.0:1783947682.657881:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 89 00000100:00100000:1.0:1783947682.657892:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+10:13745:x1870604297938816:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783947682.658149:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+10:13745:x1870604297938816:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 258us (1860us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947682.658158:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 89 00000100:00100000:2.0:1783947682.677593:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947682.677671:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297938944 00000100:00100000:1.0:1783947682.677680:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297938944 00000100:00100000:1.0:1783947682.677741:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1783947682.677750:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1870604297938944:12345-192.168.203.32@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783947682.677792:0:14186:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746@192.168.203.32@tcp t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:1.0:1783947682.677850:0:14186:0:(genops.c:1406:class_connect()) connect: client 5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746, cookie 0x20c3e53e78bb30e9 00000004:00100000:1.0:1783947682.677878:0:14186:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1783947682.677885:0:14186:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1783947682.745657:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783947682.755409:0:14186:0:(import.c:65:import_set_state_nolock()) ffff8b3c85189000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783947682.755520:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+6:2352:x1870604297938944:12345-192.168.203.32@tcp:38:mount.lustre.0 Request processed in 77769us (77936us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947682.755531:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:2.0:1783947682.758498:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947682.759733:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297939200 00000100:00100000:1.0:1783947682.759745:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297939200 00000100:00100000:2.0:1783947682.759806:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947682.759835:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297939072 00000100:00100000:2.0:1783947682.759839:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297939072 00000100:00100000:2.0:1783947682.759887:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:2.0:1783947682.759898:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+7:0:x1870604297939072:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783947682.759938:0:14185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783947682.760012:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+7:0:x1870604297939072:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 114us (215us total) trans 0 rc 0/0 00000100:00080000:3.0:1783947682.761073:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947682.762436:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:2.0:1783947682.762476:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:2.0:1783947682.762519:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+6:13723:x1870604297939200:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783947682.762548:0:14185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783947682.762604:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+6:13723:x1870604297939200:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 91us (4125us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947682.762611:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:2.0:1783947682.766224:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947682.766320:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297939328 00000100:00100000:0.0:1783947682.766339:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297939328 00000100:00100000:0.0:1783947682.766400:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:0.0:1783947682.766410:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+6:13723:x1870604297939328:12345-192.168.203.32@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783947682.766531:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+6:13723:x1870604297939328:12345-192.168.203.32@tcp:40:mount.lustre.0 Request processed in 122us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947682.766551:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:2.0:1783947682.770393:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947682.770609:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297939456 00000100:00100000:1.0:1783947682.770618:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297939456 00000100:00100000:1.0:1783947682.770670:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:1.0:1783947682.770678:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1870604297939456:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783947682.770711:0:14822:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746@192.168.203.32@tcp t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:1.0:1783947682.770743:0:14822:0:(genops.c:1406:class_connect()) connect: client 5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746, cookie 0x20c3e53e78bb30f0 00002000:00100000:1.0:1783947682.770755:0:14822:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746/ffff8b3c8518c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783947682.770787:0:14822:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783947682.771067:0:14822:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783947682.771094:0:14822:0:(import.c:65:import_set_state_nolock()) ffff8b3c8518f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783947682.771158:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+6:2352:x1870604297939456:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 479us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947682.771165:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:2.0:1783947682.773819:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947682.774920:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297939584 00000100:00100000:1.0:1783947682.774931:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297939584 00000100:00100000:1.0:1783947682.774997:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:1.0:1783947682.775005:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1870604297939584:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783947682.775036:0:14821:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746@192.168.203.32@tcp t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:1.0:1783947682.775066:0:14821:0:(genops.c:1406:class_connect()) connect: client 5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746, cookie 0x20c3e53e78bb30f7 00002000:00100000:1.0:1783947682.775078:0:14821:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746/ffff8b3c85189800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783947682.775100:0:14821:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783947682.775302:0:14821:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783947682.775342:0:14821:0:(import.c:65:import_set_state_nolock()) ffff8b3c8518c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783947682.775411:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+6:2352:x1870604297939584:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 406us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947682.775445:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:2.0:1783947682.776546:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947682.776952:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297939712 00000100:00100000:1.0:1783947682.776961:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297939712 00000100:00100000:1.0:1783947682.777005:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:1.0:1783947682.777014:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+6:13723:x1870604297939712:12345-192.168.203.32@tcp:33:mount.lustre.0 00000004:00080000:1.0:1783947682.779589:0:14187:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2518us 00000004:00200000:3.0:1783947682.789828:0:14187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1783947682.790010:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+6:13723:x1870604297939712:12345-192.168.203.32@tcp:33:mount.lustre.0 Request processed in 12991us (13463us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947682.790026:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1783947682.876340:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947682.876364:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319952256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947682.876467:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947682.883715:0:14824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319952256 00000100:00100000:0.0:1783947682.883729:0:14824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319952256 00000100:00100000:0.0:1783947682.883791:0:14824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783947682.883802:0:14824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1870604319952256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783947682.883825:0:14824:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947682.883901:0:14824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1870604319952256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (7433us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947682.883908:0:14824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783947682.888276:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319952512:0@lo:400:kworker.0 00000100:00100000:0.0:1783947682.888356:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947682.888406:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947682.888414:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319952640:0@lo:400:kworker.0 00000100:00100000:0.0:1783947682.888476:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783947682.888773:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947682.888791:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9e11f6c7-2161-442e-ac38-f4342317f92b:3314:1870604319952384:0@lo:400:kworker.0 00000100:00100000:3.0:1783947682.888825:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947682.888862:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319952896:0@lo:400:kworker.0 00000100:00100000:3.0:1783947682.888887:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947682.888929:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319952256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947682.888949:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947682.888954:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319952768:0@lo:400:kworker.0 00000100:00100000:3.0:1783947682.888976:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947682.895318:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319952512 00000100:00100000:0.0:1783947682.895342:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319952512 00000100:00100000:0.0:1783947682.899696:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319952640 00000100:00100000:0.0:1783947682.899710:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319952640 00000100:00100000:0.0:1783947682.899745:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319952896 00000100:00100000:0.0:1783947682.899748:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319952896 00000100:00100000:0.0:1783947682.899762:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319952768 00000100:00100000:0.0:1783947682.899764:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319952768 00000100:00100000:0.0:1783947682.901000:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783947682.901013:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319952640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947682.901111:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319952640:12345-0@lo:400:kworker.0 Request processed in 102us (12635us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947682.901124:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783947682.901154:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783947682.901161:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319952896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947682.901199:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870604319952896:12345-0@lo:400:kworker.0 Request processed in 39us (12310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947682.901206:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783947682.901218:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783947682.901224:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319952768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947682.901250:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870604319952768:12345-0@lo:400:kworker.0 Request processed in 28us (12274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947682.901256:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783947682.901407:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947682.901415:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319952512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947682.901501:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1870604319952512:12345-0@lo:400:kworker.0 Request processed in 88us (13146us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947682.901508:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783947682.901547:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd4baa00 x1870604319952640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947682.901562:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319952640:0@lo:400:kworker.0 00000100:00100000:0.0:1783947682.901576:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1870604319952512:0@lo:400:kworker.0 00000100:00100000:3.0:1783947682.909619:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319952384 00000100:00100000:3.0:1783947682.909633:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319952384 00000100:00100000:3.0:1783947682.909679:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783947682.909689:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+19:3314:x1870604319952384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947682.909769:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+19:3314:x1870604319952384:12345-0@lo:400:kworker.0 Request processed in 82us (20942us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947682.909777:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1783947682.909937:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947682.909942:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783947682.909972:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd4b8e00 x1870604319952768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947682.909987:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1870604319952768:0@lo:400:kworker.0 00000100:00100000:3.0:1783947682.909997:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9e11f6c7-2161-442e-ac38-f4342317f92b:3314:1870604319952384:0@lo:400:kworker.0 00010000:00080000:3.0:1783947682.910007:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b3cbd4bad80 x1870604319952896/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947682.910016:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1870604319952896:0@lo:400:kworker.0 00000100:00100000:2.0:1783947683.008355:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947683.012528:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297939840 00000100:00100000:1.0:1783947683.012541:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297939840 00000100:00100000:1.0:1783947683.012590:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:1.0:1783947683.012599:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+6:13766:x1870604297939840:12345-192.168.203.32@tcp:101:mkdir.0 00010000:00010000:1.0:1783947683.012617:0:14185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947683.012679:0:14185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ba00/0x20c3e53e78bb30fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab3fb expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947683.012736:0:14185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb3105 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947683.012760:0:14185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb3105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947683.012775:0:14185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb3105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947683.012920:0:14185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783947683.012925:0:14185:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1783947683.013003:0:14185:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb3105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947683.013038:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ba00/0x20c3e53e78bb30fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab3fb expref: 8 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947683.013054:0:14185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb3105 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab3fb expref: 7 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947683.013064:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3ca1587c00) 00010000:00010000:1.0:1783947683.013067:0:14185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947683.013070:0:14185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73ae00, rc 0) 00000100:00100000:1.0:1783947683.013129:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+7:13766:x1870604297939840:12345-192.168.203.32@tcp:101:mkdir.0 Request processed in 530us (4783us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947683.013136:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000001:00100000:3.0:1783947683.016804:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746 00000001:00100000:3.0:1783947683.016855:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783947683.016880:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1783947683.772461:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783947683.936746:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746 00010000:00010000:3.0:1783947684.795529:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947685.249749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947685.249845:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297939968 00000100:00100000:1.0:1783947685.249855:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297939968 00000100:00100000:1.0:1783947685.249927:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:1.0:1783947685.249937:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+7:13819:x1870604297939968:12345-192.168.203.32@tcp:41:lfs.0 00000004:00000024:1.0:1783947685.249996:0:14184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783947685.250073:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+7:13819:x1870604297939968:12345-192.168.203.32@tcp:41:lfs.0 Request processed in 137us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947685.250081:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00080000:2.0:1783947685.250664:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947685.255411:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947685.255726:0:14824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297940096 00000100:00100000:0.0:1783947685.255740:0:14824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297940096 00000100:00100000:0.0:1783947685.255840:0:14824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:0.0:1783947685.255852:0:14824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+5:13819:x1870604297940096:12345-192.168.203.32@tcp:13:lfs.0 00002000:00000024:0.0:1783947685.255936:0:14824:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947685.256045:0:14824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+5:13819:x1870604297940096:12345-192.168.203.32@tcp:13:lfs.0 Request processed in 194us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947685.256053:0:14824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00080000:2.0:1783947685.256366:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947685.260840:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947685.261821:0:14824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297940224 00000100:00100000:0.0:1783947685.261840:0:14824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297940224 00000100:00100000:0.0:1783947685.262058:0:14824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:0.0:1783947685.262071:0:14824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+5:13819:x1870604297940224:12345-192.168.203.32@tcp:13:lfs.0 00002000:00000024:0.0:1783947685.262127:0:14824:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947685.262245:0:14824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+5:13819:x1870604297940224:12345-192.168.203.32@tcp:13:lfs.0 Request processed in 176us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947685.262253:0:14824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00080000:2.0:1783947685.262355:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947685.436572:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947685.436605:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319953024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947685.436707:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947685.436928:0:14824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319953024 00000100:00100000:0.0:1783947685.436939:0:14824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319953024 00000100:00100000:0.0:1783947685.437021:0:14824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783947685.437031:0:14824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319953024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947685.437062:0:14824:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947685.437122:0:14824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319953024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947685.437129:0:14824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783947685.437221:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319953024:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783947685.437364:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947685.498486:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947685.498674:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297940352 00000100:00100000:0.0:1783947685.498688:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297940352 00000100:00100000:0.0:1783947685.498766:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 91 00000100:00100000:0.0:1783947685.498779:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+10:13850:x1870604297940352:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783947685.498805:0:14177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947685.498852:0:14177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c85671400/0x20c3e53e78bb310c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab402 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947685.498892:0:14177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c85671400/0x20c3e53e78bb310c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab402 expref: 11 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947685.498906:0:14177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c85671400/0x20c3e53e78bb310c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab402 expref: 11 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947685.498919:0:14177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671400, rc 0) 00000100:00100000:0.0:1783947685.498999:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+11:13850:x1870604297940352:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 223us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947685.499006:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 91 00000100:00100000:3.0:1783947685.501907:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947685.502029:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297940480 00000100:00100000:1.0:1783947685.502042:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297940480 00000100:00100000:1.0:1783947685.502117:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 92 00000100:00100000:1.0:1783947685.502130:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+11:13850:x1870604297940480:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783947685.502647:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+11:13850:x1870604297940480:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 517us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947685.502657:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 92 00000100:00100000:1.0:1783947685.504989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947685.505276:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297940608 00000100:00100000:3.0:1783947685.505290:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297940608 00000100:00100000:3.0:1783947685.505543:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:3.0:1783947685.505556:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6916452-685c-4987-9050-344ce2627597+11:13850:x1870604297940608:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783947685.506864:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6916452-685c-4987-9050-344ce2627597+11:13850:x1870604297940608:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 1297us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947685.506881:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:3.0:1783947685.525888:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947685.526059:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297940736 00000100:00100000:0.0:1783947685.526072:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297940736 00000100:00100000:0.0:1783947685.526189:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 94 00000100:00100000:0.0:1783947685.526201:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+11:13857:x1870604297940736:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783947685.528124:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+11:13857:x1870604297940736:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 1911us (2239us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947685.528142:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 94 00000100:00100000:0.0:1783947685.614720:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947685.614868:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297940864 00000100:00100000:3.0:1783947685.614881:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297940864 00000100:00100000:3.0:1783947685.614956:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 95 00000100:00100000:3.0:1783947685.614968:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6916452-685c-4987-9050-344ce2627597+11:13857:x1870604297940864:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783947685.615359:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6916452-685c-4987-9050-344ce2627597+11:13857:x1870604297940864:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 392us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947685.615370:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 95 00000100:00100000:2.0:1783947685.626840:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947685.636082:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297940992 00000100:00100000:0.0:1783947685.636105:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297940992 00000100:00100000:0.0:1783947685.636201:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 96 00000100:00100000:0.0:1783947685.636213:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+11:13850:x1870604297940992:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783947685.636234:0:14177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947685.636257:0:14177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c85670c00/0x20c3e53e78bb3113 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab42c expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947685.636323:0:14177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c85670c00/0x20c3e53e78bb3113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab42c expref: 12 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947685.636336:0:14177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c85670c00/0x20c3e53e78bb3113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab42c expref: 12 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947685.636347:0:14177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85670c00, rc 0) 00000100:00100000:0.0:1783947685.636803:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+12:13850:x1870604297940992:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 538us (9929us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947685.636811:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 96 00000100:00100000:2.0:1783947685.643812:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947685.644031:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297941120 00000100:00100000:1.0:1783947685.644045:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297941120 00000100:00100000:1.0:1783947685.644118:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:1.0:1783947685.644130:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+12:13850:x1870604297941120:12345-192.168.203.32@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783947685.644168:0:14178:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783947685.644199:0:14178:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783947685.644205:0:14178:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783947685.644208:0:14178:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783947685.644210:0:14178:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1783947685.646176:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+12:13850:x1870604297941120:12345-192.168.203.32@tcp:256:mount.lustre.0 Request processed in 2035us (2380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947685.646194:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:2.0:1783947685.649290:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947685.650677:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297941248 00000100:00100000:0.0:1783947685.650696:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297941248 00000100:00100000:0.0:1783947685.651252:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00100000:0.0:1783947685.651269:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+12:13850:x1870604297941248:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783947685.651294:0:14177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947685.651328:0:14177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb311a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab433 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947685.651369:0:14177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb311a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab433 expref: 13 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947685.651383:0:14177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb311a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab433 expref: 13 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947685.651473:0:14177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671e00, rc 0) 00000100:00100000:0.0:1783947685.651555:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+13:13850:x1870604297941248:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 292us (2280us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947685.651563:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00100000:2.0:1783947685.654388:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947685.654761:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297941376 00000100:00100000:1.0:1783947685.654774:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297941376 00000100:00100000:1.0:1783947685.654948:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 99 00000100:00100000:1.0:1783947685.654961:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+13:13850:x1870604297941376:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783947685.655435:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+13:13850:x1870604297941376:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 448us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947685.655447:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 99 00000100:00100000:2.0:1783947685.657899:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947685.659112:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297941504 00000100:00100000:0.0:1783947685.659127:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297941504 00000100:00100000:0.0:1783947685.659281:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 100 00000100:00100000:0.0:1783947685.659304:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+13:13850:x1870604297941504:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783947685.659653:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+13:13850:x1870604297941504:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 363us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947685.659664:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 100 00000100:00100000:3.0:1783947685.663224:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947685.665130:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297941632 00000100:00100000:1.0:1783947685.665147:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297941632 00000100:00100000:1.0:1783947685.665214:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 101 00000100:00100000:1.0:1783947685.665226:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+13:13863:x1870604297941632:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783947685.665843:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+13:13863:x1870604297941632:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 615us (2630us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947685.665854:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 101 00000100:00100000:3.0:1783947685.670583:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947685.670877:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297941760 00000100:00100000:1.0:1783947685.670893:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297941760 00000100:00100000:1.0:1783947685.670949:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 102 00000100:00100000:1.0:1783947685.670960:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+13:13863:x1870604297941760:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783947685.671271:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+13:13863:x1870604297941760:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 311us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947685.671280:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 102 00000100:00100000:3.0:1783947685.683230:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947685.683598:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297941888 00000100:00100000:1.0:1783947685.683612:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297941888 00000100:00100000:1.0:1783947685.683683:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:1.0:1783947685.683693:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1870604297941888:12345-192.168.203.32@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783947685.683732:0:14186:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from dadc93e9-b617-4dbb-81a2-fd9a39f0423d@192.168.203.32@tcp t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:1.0:1783947685.683802:0:14186:0:(genops.c:1406:class_connect()) connect: client dadc93e9-b617-4dbb-81a2-fd9a39f0423d, cookie 0x20c3e53e78bb3121 00000004:00100000:1.0:1783947685.683845:0:14186:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783947685.684007:0:14186:0:(import.c:65:import_set_state_nolock()) ffff8b3cb63ad000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783947685.684105:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+6:2352:x1870604297941888:12345-192.168.203.32@tcp:38:mount.lustre.0 Request processed in 411us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947685.684115:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:2.0:1783947685.691550:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947685.692819:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297942144 00000100:00100000:1.0:1783947685.692836:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297942144 00000100:00100000:1.0:1783947685.692933:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:1.0:1783947685.692944:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+6:13850:x1870604297942144:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783947685.692983:0:14185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783947685.693084:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+6:13850:x1870604297942144:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 141us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947685.693092:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:1.0:1783947685.695350:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947685.695391:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00080000:2.0:1783947685.696690:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947685.700971:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297942016 00000100:00100000:0.0:1783947685.700993:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297942016 00000100:00100000:3.0:1783947685.702520:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297942272 00000100:00100000:3.0:1783947685.702536:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297942272 00000100:00100000:2.0:1783947685.702850:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:2.0:1783947685.702864:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+7:13850:x1870604297942272:12345-192.168.203.32@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783947685.702991:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+7:13850:x1870604297942272:12345-192.168.203.32@tcp:40:mount.lustre.0 Request processed in 130us (7598us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947685.702999:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:0.0:1783947685.707656:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947685.707711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947685.707778:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947685.707828:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297942400 00000100:00100000:0.0:1783947685.707841:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297942400 00000100:00100000:0.0:1783947685.707887:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297942528 00000100:00100000:0.0:1783947685.707891:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297942528 00000100:00100000:0.0:1783947685.707907:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:0.0:1783947685.707917:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1870604297942400:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783947685.707963:0:14819:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from dadc93e9-b617-4dbb-81a2-fd9a39f0423d@192.168.203.32@tcp t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:0.0:1783947685.708005:0:14819:0:(genops.c:1406:class_connect()) connect: client dadc93e9-b617-4dbb-81a2-fd9a39f0423d, cookie 0x20c3e53e78bb3128 00002000:00100000:0.0:1783947685.708021:0:14819:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dadc93e9-b617-4dbb-81a2-fd9a39f0423d/ffff8b3b8410e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783947685.708050:0:14819:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783947685.708377:0:14819:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783947685.708482:0:14819:0:(import.c:65:import_set_state_nolock()) ffff8b3b8410b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947685.708644:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297942656 00000100:00100000:2.0:1783947685.708650:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297942656 00000100:00100000:2.0:1783947685.708691:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:2.0:1783947685.708700:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+7:13850:x1870604297942656:12345-192.168.203.32@tcp:33:mount.lustre.0 00000004:00200000:2.0:1783947685.708926:0:14188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1783947685.710651:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:1.0:1783947685.710667:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+7:0:x1870604297942016:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783947685.710708:0:14185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783947685.711352:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+6:2352:x1870604297942400:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 3430us (3634us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947685.711365:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:0.0:1783947685.711397:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1783947685.711411:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1870604297942528:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783947685.711755:0:14819:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from dadc93e9-b617-4dbb-81a2-fd9a39f0423d@192.168.203.32@tcp t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:0.0:1783947685.711807:0:14819:0:(genops.c:1406:class_connect()) connect: client dadc93e9-b617-4dbb-81a2-fd9a39f0423d, cookie 0x20c3e53e78bb312f 00002000:00100000:0.0:1783947685.711824:0:14819:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dadc93e9-b617-4dbb-81a2-fd9a39f0423d/ffff8b3b84108800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783947685.711839:0:14819:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783947685.712116:0:14819:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783947685.712150:0:14819:0:(import.c:65:import_set_state_nolock()) ffff8b3b8410b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947685.712412:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+7:13850:x1870604297942656:12345-192.168.203.32@tcp:33:mount.lustre.0 Request processed in 3702us (4760us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947685.712445:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:1.0:1783947685.712925:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+6:0:x1870604297942016:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 2259us (17586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947685.712935:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:0.0:1783947685.725934:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+6:2352:x1870604297942528:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 14508us (18134us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947685.725956:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00010000:00010000:3.0:1783947685.818084:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947685.903912:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947685.904190:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297942784 00000100:00100000:3.0:1783947685.904200:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297942784 00000100:00100000:3.0:1783947685.904268:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:3.0:1783947685.904279:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+6:13884:x1870604297942784:12345-192.168.203.32@tcp:101:mkdir.0 00010000:00010000:3.0:1783947685.904300:0:14186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947685.904330:0:14186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb3136 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab45d expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947685.904390:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1b200/0x20c3e53e78bb313d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947685.904403:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1b200/0x20c3e53e78bb313d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947685.904442:0:14186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1b200/0x20c3e53e78bb313d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947685.904655:0:14186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783947685.904660:0:14186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947685.904752:0:14186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1b200/0x20c3e53e78bb313d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947685.904779:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb3136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab45d expref: 8 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947685.904796:0:14186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1b200/0x20c3e53e78bb313d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab45d expref: 7 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947685.904805:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3ca1587c00) 00010000:00010000:3.0:1783947685.904808:0:14186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947685.904817:0:14186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3ca9d1b200, rc 0) 00000100:00100000:3.0:1783947685.904872:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+7:13884:x1870604297942784:12345-192.168.203.32@tcp:101:mkdir.0 Request processed in 595us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947685.904880:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00010000:00010000:3.0:1783947686.842269:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783947687.163027:0:14219:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783947687.868225:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947687.993845:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319953536:0@lo:400:kworker.0 00000100:00100000:2.0:1783947687.993924:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947687.993992:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783947687.994002:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9e11f6c7-2161-442e-ac38-f4342317f92b:3311:1870604319953152:0@lo:400:kworker.0 00000100:00100000:2.0:1783947687.994032:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947687.994054:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319953664:0@lo:400:kworker.0 00000100:00100000:2.0:1783947687.994076:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947687.994211:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319953280:0@lo:400:kworker.0 00000100:00100000:0.0:1783947687.994244:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947687.994274:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319953792:0@lo:400:kworker.0 00000100:00100000:0.0:1783947687.994311:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947687.994328:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947687.994342:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319953408:0@lo:400:kworker.0 00000100:00100000:0.0:1783947687.994366:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947687.994457:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319953536 00000100:00100000:1.0:1783947687.994465:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319953536 00000100:00100000:1.0:1783947687.994496:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319953664 00000100:00100000:1.0:1783947687.994499:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319953664 00000100:00100000:1.0:1783947687.994528:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319953792 00000100:00100000:1.0:1783947687.994532:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319953792 00000100:00100000:1.0:1783947687.994546:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783947687.994554:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319953536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947687.994608:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870604319953536:12345-0@lo:400:kworker.0 Request processed in 54us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947687.994615:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783947687.994631:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783947687.994637:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319953664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947687.994664:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319953664:12345-0@lo:400:kworker.0 Request processed in 28us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947687.994671:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783947687.994682:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783947687.994687:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319953792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947687.994719:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870604319953792:12345-0@lo:400:kworker.0 Request processed in 31us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947687.994725:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783947687.994743:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319953152 00000100:00100000:1.0:1783947687.994747:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319953152 00000100:00100000:1.0:1783947687.994770:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783947687.994776:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+19:3311:x1870604319953152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947687.994804:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+19:3311:x1870604319953152:12345-0@lo:400:kworker.0 Request processed in 29us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947687.994810:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783947687.994910:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319953280 00000100:00100000:2.0:1783947687.994915:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319953280 00000100:00100000:2.0:1783947687.994957:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319953408 00000100:00100000:2.0:1783947687.994961:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319953408 00000100:00100000:2.0:1783947687.994980:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783947687.994987:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319953280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947687.995021:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319953280:12345-0@lo:400:kworker.0 Request processed in 35us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947687.995026:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783947687.995040:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783947687.995046:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319953408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947687.995084:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319953408:12345-0@lo:400:kworker.0 Request processed in 39us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947687.995089:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1783947687.995234:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783947687.995239:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783947687.995241:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947687.995966:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1783947687.995986:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319953408:0@lo:400:kworker.0 00000100:00100000:1.0:1783947687.996012:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319953280:0@lo:400:kworker.0 00000100:00100000:1.0:1783947687.996023:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1870604319953792:0@lo:400:kworker.0 00000100:00100000:1.0:1783947687.996060:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9e11f6c7-2161-442e-ac38-f4342317f92b:3311:1870604319953152:0@lo:400:kworker.0 00000100:00100000:1.0:1783947687.996072:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319953664:0@lo:400:kworker.0 00000100:00100000:1.0:1783947687.996081:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870604319953536:0@lo:400:kworker.0 00000100:00100000:1.0:1783947687.997319:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319953920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947687.997375:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947687.998935:0:14824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319953920 00000100:00100000:0.0:1783947687.998948:0:14824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319953920 00000100:00100000:0.0:1783947687.999003:0:14824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783947687.999013:0:14824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319953920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783947687.999047:0:14824:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947687.999112:0:14824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319953920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947687.999119:0:14824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783947687.999538:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319953920:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1783947688.027708:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dadc93e9-b617-4dbb-81a2-fd9a39f0423d 00000001:00100000:1.0:1783947688.027723:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746 00000001:00100000:3.0:1783947688.060906:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dadc93e9-b617-4dbb-81a2-fd9a39f0423d 00000001:02000400:1.0:1783947688.528164:0:16064:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1783947688.890718:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783947689.109849:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dadc93e9-b617-4dbb-81a2-fd9a39f0423d 00010000:00010000:1.0:1783947689.915591:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947690.555479:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947690.555503:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319954048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947690.555569:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947690.555635:0:14824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319954048 00000100:00100000:0.0:1783947690.555643:0:14824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319954048 00000100:00100000:0.0:1783947690.555709:0:14824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783947690.555718:0:14824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319954048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947690.555755:0:14824:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947690.555813:0:14824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319954048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947690.555821:0:14824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783947690.555836:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319954048:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783947690.555847:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947690.756222:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947690.756299:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297943040 00000100:00100000:1.0:1783947690.756309:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297943040 00000100:00100000:2.0:1783947690.756316:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947690.756380:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:1.0:1783947690.756391:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+6:2353:x1870604297943040:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947690.756393:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00080000:0.0:1783947690.756435:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947690.756503:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+6:2353:x1870604297943040:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 114us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947690.756511:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:2.0:1783947690.758223:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947690.758258:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947690.758267:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297942912 00000100:00100000:1.0:1783947690.758283:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297942912 00000100:00100000:1.0:1783947690.758325:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 104 00000100:00100000:1.0:1783947690.758334:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+13:2353:x1870604297942912:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947690.758403:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+13:2353:x1870604297942912:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 69us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947690.758410:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 104 00000100:00100000:3.0:1783947690.758478:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297943296 00000100:00100000:3.0:1783947690.758483:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297943296 00000100:00100000:3.0:1783947690.758520:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297943552 00000100:00100000:3.0:1783947690.758532:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297943552 00000100:00100000:3.0:1783947690.758551:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:3.0:1783947690.758566:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+5:2353:x1870604297943296:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947690.758617:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+5:2353:x1870604297943296:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 51us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947690.758624:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:3.0:1783947690.758638:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:3.0:1783947690.758643:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+5:2353:x1870604297943552:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947690.758689:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+5:2353:x1870604297943552:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 45us (2294us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947690.758696:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:2.0:1783947690.760817:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947690.760876:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947690.760920:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297943424 00000100:00100000:1.0:1783947690.760928:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297943424 00000100:00100000:0.0:1783947690.760928:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297943168 00000100:00100000:0.0:1783947690.760931:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297943168 00000100:00100000:1.0:1783947690.760981:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:1.0:1783947690.760991:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+6:2353:x1870604297943424:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1783947690.761058:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+6:2353:x1870604297943424:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 69us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947690.761066:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:3.0:1783947690.762946:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:3.0:1783947690.762967:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+5:2353:x1870604297943168:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947690.763088:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+5:2353:x1870604297943168:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 128us (4828us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947690.763096:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:3.0:1783947690.763451:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297943680 00000100:00100000:3.0:1783947690.763459:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297943680 00000100:00100000:3.0:1783947690.763502:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:3.0:1783947690.763508:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+5:2353:x1870604297943680:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1783947690.764591:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+5:2353:x1870604297943680:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 1065us (3697us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947690.764602:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00080000:0.0:1783947690.764630:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947690.764636:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783947690.764638:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783947690.941299:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947691.963726:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783947691.990116:0:16212:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb30ddcc0 20000000:00000080:1.0:1783947691.990132:0:16212:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b3b86cac400 uarg=0000000000000000 20000000:01000000:1.0:1783947691.990167:0:16212:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783947691.990172:0:16212:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783947691.990176:0:16212:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783947691.996885:0:16213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1783947691.997123:0:16212:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783947692.004814:0:16212:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783947692.004842:0:16212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb3144 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.004861:0:16212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3cc0630c00/0x20c3e53e78bb2e3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2e34 expref: 18 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.004868:0:16212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3cbd825600/0x20c3e53e78bb2e88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2e81 expref: 18 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.004874:0:16212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3cbd825400/0x20c3e53e78bb2fc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb2fbc expref: 18 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.004900:0:16212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb30e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab3d1 expref: 12 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.004907:0:16212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb311a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab433 expref: 12 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.004915:0:16212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb3144 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.004953:0:16212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb311a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab433 expref: 12 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.004968:0:16212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb311a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab433 expref: 12 pid: 14177 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947692.004981:0:16212:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1870604319954176:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947692.005128:0:16212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb30e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab3d1 expref: 12 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.005136:0:16212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb30e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab3d1 expref: 12 pid: 14179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947692.005144:0:16212:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83375c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1870604319954304:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947692.005178:0:16212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3cbd825400/0x20c3e53e78bb2fc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb2fbc expref: 18 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.005186:0:16212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b3cbd825400/0x20c3e53e78bb2fc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb2fbc expref: 18 pid: 14179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947692.005205:0:16212:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1870604319954432:0@lo:104: 00000100:00100000:1.0:1783947692.005242:0:16212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783947692.005294:0:16212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3cbd825600/0x20c3e53e78bb2e88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb2e81 expref: 18 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.005302:0:16212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b3cbd825600/0x20c3e53e78bb2e88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb2e81 expref: 18 pid: 14179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947692.005310:0:16212:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1870604319954560:0@lo:104: 00000100:00100000:1.0:1783947692.005330:0:16212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783947692.005368:0:16212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b3cc0630c00/0x20c3e53e78bb2e3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20c3e53e78bb2e34 expref: 18 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.005376:0:16212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b3cc0630c00/0x20c3e53e78bb2e3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20c3e53e78bb2e34 expref: 18 pid: 14177 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947692.005384:0:16212:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1870604319954688:0@lo:104: 00000100:00100000:3.0:1783947692.005400:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319954432 00000100:00100000:1.0:1783947692.005406:0:16212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947692.005407:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319954432 00000100:00100000:1.0:1783947692.005792:0:16212:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3ca02af900 going to sleep for 11 seconds 00000100:00100000:0.0:1783947692.010826:0:14167:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783947692.010854:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319954560 00000100:00100000:0.0:1783947692.010864:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319954560 00000100:00100000:0.0:1783947692.010903:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319954688 00000100:00100000:0.0:1783947692.010906:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319954688 00000100:00100000:0.0:1783947692.010923:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783947692.010932:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83375f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9e11f6c7-2161-442e-ac38-f4342317f92b+5:16212:x1870604319954432:12345-0@lo:104: 00010000:00010000:0.0:1783947692.010949:0:14167:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825200/0x20c3e53e78bb2fbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb2fc3 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947692.011029:0:14167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783947692.011034:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83375f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9e11f6c7-2161-442e-ac38-f4342317f92b+5:16212:x1870604319954432:12345-0@lo:104: Request processed in 104us (5793us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947692.011042:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783947692.011059:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947692.011064:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83377480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9e11f6c7-2161-442e-ac38-f4342317f92b+4:16212:x1870604319954560:12345-0@lo:104: 00010000:00010000:0.0:1783947692.011071:0:14167:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3c85671a00/0x20c3e53e78bb2e81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb2e88 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947692.011100:0:14167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783947692.011104:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83377480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9e11f6c7-2161-442e-ac38-f4342317f92b+4:16212:x1870604319954560:12345-0@lo:104: Request processed in 41us (5774us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947692.011109:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947692.011119:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783947692.011124:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c8338fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9e11f6c7-2161-442e-ac38-f4342317f92b+3:16212:x1870604319954688:12345-0@lo:104: 00010000:00010000:0.0:1783947692.011130:0:14167:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825a00/0x20c3e53e78bb2e34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb2e3b expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947692.011179:0:14167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783947692.011184:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c8338fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9e11f6c7-2161-442e-ac38-f4342317f92b+3:16212:x1870604319954688:12345-0@lo:104: Request processed in 60us (5777us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947692.011189:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783947692.011567:0:16212:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1870604319954432:0@lo:104: 00010000:00010000:0.0:1783947692.017041:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783947692.017068:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825200/0x20c3e53e78bb2fbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb2fc3 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947692.017080:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd825200 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:0.0:1783947692.017092:0:14173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825200/0x20c3e53e78bb2fbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb2fc3 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947692.017102:0:14173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825200/0x20c3e53e78bb2fbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb2fc3 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947692.017110:0:14173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825200/0x20c3e53e78bb2fbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb2fc3 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947692.017125:0:14173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783947692.017185:0:14173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825200/0x20c3e53e78bb2fbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2fc3 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947692.017207:0:14173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783947692.017308:0:16212:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1870604319954560:0@lo:104: 00000100:00100000:2.0:1783947692.017312:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9e11f6c7-2161-442e-ac38-f4342317f92b:3312:1870604319954816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947692.017326:0:16212:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1870604319954688:0@lo:104: 00010000:00010000:1.0:1783947692.017470:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947692.017476:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3c85671a00/0x20c3e53e78bb2e81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb2e88 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.017485:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671a00 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:1.0:1783947692.017501:0:14172:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3c85671a00/0x20c3e53e78bb2e81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb2e88 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.017509:0:14172:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3c85671a00/0x20c3e53e78bb2e81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb2e88 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947692.017516:0:14172:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3c85671a00/0x20c3e53e78bb2e81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb2e88 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947692.017522:0:14172:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783947692.017542:0:14172:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3c85671a00/0x20c3e53e78bb2e81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2e88 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.017548:0:14172:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947692.017560:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3c85671a00/0x20c3e53e78bb2e81 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2e88 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.017579:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3c85671a00/0x20c3e53e78bb2e81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2e88 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.017594:0:14172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947692.017597:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825a00/0x20c3e53e78bb2e34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x20c3e53e78bb2e3b expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.017602:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cbd825a00 already unused, calling callback (ffffffffc1b6dc20) 10000000:00010000:1.0:1783947692.017605:0:14172:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825a00/0x20c3e53e78bb2e34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x20c3e53e78bb2e3b expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.017611:0:14172:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825a00/0x20c3e53e78bb2e34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x20c3e53e78bb2e3b expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947692.017628:0:14172:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825a00/0x20c3e53e78bb2e34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x20c3e53e78bb2e3b expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947692.017634:0:14172:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783947692.017647:0:14172:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825a00/0x20c3e53e78bb2e34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2e3b expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.017653:0:14172:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947692.017658:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825a00/0x20c3e53e78bb2e34 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2e3b expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.017665:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825a00/0x20c3e53e78bb2e34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2e3b expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.017674:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947692.017675:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947692.017677:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947692.017686:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9e11f6c7-2161-442e-ac38-f4342317f92b:3313:1870604319954944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947692.017753:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947692.017792:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947692.017797:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9e11f6c7-2161-442e-ac38-f4342317f92b:3313:1870604319955072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947692.017814:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783947692.018230:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825200/0x20c3e53e78bb2fbc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2fc3 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947692.018249:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff8b3cbd825200/0x20c3e53e78bb2fbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20c3e53e78bb2fc3 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947692.018294:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947692.018296:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947692.018298:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947692.018305:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947692.018326:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319954944 00000100:00100000:0.0:1783947692.018332:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319954944 00000100:00100000:1.0:1783947692.018551:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319955072 00000100:00100000:1.0:1783947692.018557:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319955072 00010000:00010000:0.0:1783947692.018562:0:14171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3cbd825600/0x20c3e53e78bb2e88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb2e81 expref: 20 pid: 14179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.018587:0:14169:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3cc0630c00/0x20c3e53e78bb2e3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb2e34 expref: 20 pid: 14177 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947692.018622:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783947692.018630:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e11f6c7-2161-442e-ac38-f4342317f92b+20:3313:x1870604319955072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947692.018650:0:14169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947692.018656:0:14169:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3cc0630c00/0x20c3e53e78bb2e3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb2e34 expref: 20 pid: 14177 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.018667:0:14169:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3cc0630c00/0x20c3e53e78bb2e3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb2e34 expref: 20 pid: 14177 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.018681:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cc0630c00/0x20c3e53e78bb2e3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb2e34 expref: 20 pid: 14177 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.018704:0:14169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947692.018753:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e11f6c7-2161-442e-ac38-f4342317f92b+19:3313:x1870604319955072:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947692.018761:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783947692.018793:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9e11f6c7-2161-442e-ac38-f4342317f92b:3313:1870604319955072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947692.018892:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947692.018910:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83375180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e11f6c7-2161-442e-ac38-f4342317f92b+18:3313:x1870604319954944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947692.018919:0:14171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947692.018935:0:14171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3cbd825600/0x20c3e53e78bb2e88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb2e81 expref: 18 pid: 14179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947692.018944:0:14171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3cbd825600/0x20c3e53e78bb2e88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb2e81 expref: 18 pid: 14179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947692.018953:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cbd825600/0x20c3e53e78bb2e88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb2e81 expref: 18 pid: 14179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947692.018962:0:14171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947692.018993:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83375180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e11f6c7-2161-442e-ac38-f4342317f92b+17:3313:x1870604319954944:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947692.019000:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947692.019053:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9e11f6c7-2161-442e-ac38-f4342317f92b:3313:1870604319954944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947692.019516:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947692.019827:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319954816 00000100:00100000:2.0:1783947692.019832:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319954816 00010000:00010000:2.0:1783947692.019853:0:14170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3cbd825400/0x20c3e53e78bb2fc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb2fbc expref: 17 pid: 14179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947692.019987:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947692.019997:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbda24050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e11f6c7-2161-442e-ac38-f4342317f92b+17:3312:x1870604319954816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947692.020089:0:14170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947692.020094:0:14170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3cbd825400/0x20c3e53e78bb2fc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20c3e53e78bb2fbc expref: 17 pid: 14179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947692.020104:0:14170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3cbd825400/0x20c3e53e78bb2fc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20c3e53e78bb2fbc expref: 17 pid: 14179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947692.020116:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cbd825400/0x20c3e53e78bb2fc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20c3e53e78bb2fbc expref: 17 pid: 14179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947692.020138:0:14170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947692.020177:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbda24050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e11f6c7-2161-442e-ac38-f4342317f92b+16:3312:x1870604319954816:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947692.020184:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783947692.020948:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9e11f6c7-2161-442e-ac38-f4342317f92b:3312:1870604319954816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947692.024751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947692.024804:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297943808 00000100:00100000:0.0:1783947692.024814:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297943808 00010000:00010000:0.0:1783947692.024851:0:14171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb311a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab433 expref: 13 pid: 14177 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947692.024897:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:0.0:1783947692.024907:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6916452-685c-4987-9050-344ce2627597+13:2353:x1870604297943808:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947692.024921:0:14171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947692.024927:0:14171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb311a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab433 expref: 13 pid: 14177 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947692.024977:0:16212:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1870604319954176:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947692.024988:0:16212:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83375c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1870604319954304:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947692.025018:0:16212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb3144 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947692.025108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947692.025188:0:14170:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1783947692.025196:0:14170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1783947692.025314:0:14169:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783947692.025326:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297943936 00000100:00100000:2.0:1783947692.025340:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297943936 00010000:00010000:2.0:1783947692.025359:0:14169:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb30e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab3d1 expref: 14 pid: 14179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947692.025376:0:14169:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1783947692.025392:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:1.0:1783947692.025402:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6916452-685c-4987-9050-344ce2627597+14:2353:x1870604297943936:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947692.025415:0:14170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947692.025444:0:14171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb311a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab433 expref: 14 pid: 14177 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947692.025463:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c85671e00/0x20c3e53e78bb311a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab433 expref: 14 pid: 14177 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947692.025480:0:14171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947692.025493:0:14170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb30e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab3d1 expref: 13 pid: 14179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.025520:0:14170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb30e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab3d1 expref: 13 pid: 14179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.025535:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3c85671600/0x20c3e53e78bb30e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab3d1 expref: 13 pid: 14179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947692.025536:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6916452-685c-4987-9050-344ce2627597+13:2353:x1870604297943808:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 627us (791us total) trans 0 rc 0/0 00010000:00010000:1.0:1783947692.025559:0:14170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb3144 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.025566:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb3144 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.025579:0:14170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb3144 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.025586:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb3144 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.025592:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb3144 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.025599:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb3144 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.025604:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b600 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947692.025608:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb3144 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.025616:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb3144 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.025639:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb3144 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.025648:0:14170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947692.025668:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6916452-685c-4987-9050-344ce2627597+12:2353:x1870604297943936:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 268us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947692.028551:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:1.0:1783947692.028564:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00010000:00010000:1.0:1783947692.028781:0:16212:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb3144 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.028792:0:16212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb3144 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.028800:0:16212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b3cad73b600/0x20c3e53e78bb3144 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947692.986482:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947693.114045:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947693.114068:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319955200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947693.114172:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947693.114232:0:14824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319955200 00000100:00100000:3.0:1783947693.114239:0:14824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319955200 00000100:00100000:3.0:1783947693.114302:0:14824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947693.114310:0:14824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319955200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783947693.114342:0:14824:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783947693.114397:0:14824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319955200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947693.114414:0:14824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1783947693.114457:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947693.114495:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319955200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947693.114618:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319955456:0@lo:400:kworker.0 00000100:00100000:0.0:1783947693.114651:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947693.114685:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947693.114691:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319955584:0@lo:400:kworker.0 00000100:00100000:0.0:1783947693.114714:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947693.114765:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319955456 00000100:00100000:2.0:1783947693.114781:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319955456 00000100:00100000:2.0:1783947693.114819:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783947693.114827:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319955456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947693.114869:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319955456:12345-0@lo:400:kworker.0 Request processed in 44us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947693.114876:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1783947693.114896:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947693.114915:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319955456:0@lo:400:kworker.0 00000100:00100000:3.0:1783947693.115027:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319955584 00000100:00100000:3.0:1783947693.115031:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319955584 00000100:00100000:3.0:1783947693.115063:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783947693.115070:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319955584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947693.115076:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319955712:0@lo:400:kworker.0 00000100:00100000:1.0:1783947693.115102:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947693.115105:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319955584:12345-0@lo:400:kworker.0 Request processed in 36us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947693.115111:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783947693.115120:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783947693.115121:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319955712 00000100:00100000:3.0:1783947693.115125:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319955712 00000100:00100000:1.0:1783947693.115126:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9e11f6c7-2161-442e-ac38-f4342317f92b:3311:1870604319955328:0@lo:400:kworker.0 00000100:00100000:3.0:1783947693.115144:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783947693.115148:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319955712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947693.115150:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947693.115169:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319955840:0@lo:400:kworker.0 00000100:00100000:3.0:1783947693.115174:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319955712:12345-0@lo:400:kworker.0 Request processed in 26us (71us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947693.115179:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783947693.115186:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783947693.115192:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947693.115290:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319955712:0@lo:400:kworker.0 00000100:00100000:3.0:1783947693.115327:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319955584:0@lo:400:kworker.0 00000100:00100000:0.0:1783947693.115350:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319955840 00000100:00100000:0.0:1783947693.115354:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319955840 00000100:00100000:0.0:1783947693.115394:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783947693.115400:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319955840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947693.115451:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319955840:12345-0@lo:400:kworker.0 Request processed in 51us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947693.115457:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783947693.115479:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319955840:0@lo:400:kworker.0 00000100:00100000:1.0:1783947693.115594:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319955328 00000100:00100000:1.0:1783947693.115598:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319955328 00000100:00100000:1.0:1783947693.115635:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783947693.115641:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+16:3311:x1870604319955328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947693.115714:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9e11f6c7-2161-442e-ac38-f4342317f92b:3311:1870604319955328:0@lo:400:kworker.0 00000100:00100000:1.0:1783947693.115743:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+16:3311:x1870604319955328:12345-0@lo:400:kworker.0 Request processed in 36us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947693.115751:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1783947693.118499:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1783947693.241508:0:14182:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783947693.241516:0:14182:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3cb6185000 from 10 10000000:01000000:2.0:1783947693.241521:0:14182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783947693.241567:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631000/0x20c3e53e78bb314b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947693.241579:0:14182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631000/0x20c3e53e78bb314b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947693.241612:0:14182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631000/0x20c3e53e78bb314b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947693.241640:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319955968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783947693.241804:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947693.241849:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c880d0240 going to sleep for 11 seconds 00000100:00100000:1.0:1783947693.242540:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319955968 00000100:00100000:1.0:1783947693.242550:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319955968 00000100:00100000:1.0:1783947693.242686:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783947693.242704:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+16:14182:x1870604319955968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947693.242721:0:14178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947693.242737:0:14178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cad73b400/0x20c3e53e78bb3152 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb314b expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947693.242761:0:14178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cad73b400/0x20c3e53e78bb3152 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb314b expref: 17 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947693.242772:0:14178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cad73b400/0x20c3e53e78bb3152 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb314b expref: 17 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947693.242782:0:14178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73b400, rc 0) 00000100:00100000:1.0:1783947693.242831:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+17:14182:x1870604319955968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947693.242838:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783947693.247859:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319955968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947693.247888:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631000/0x20c3e53e78bb314b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb3152 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947693.247899:0:14182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631000/0x20c3e53e78bb314b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb3152 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947693.247975:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319956096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947693.248046:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947693.248082:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c8642df00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947693.249958:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319956096 00000100:00100000:1.0:1783947693.249969:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319956096 00000100:00100000:1.0:1783947693.250021:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783947693.250038:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+17:14182:x1870604319956096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947693.250309:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+17:14182:x1870604319956096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (2262us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947693.250322:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783947693.250358:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319956096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947693.250400:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c83374700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319956224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947693.250470:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947693.250496:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c9f5ad240 going to sleep for 11 seconds 00000100:00100000:1.0:1783947693.250508:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319956224 00000100:00100000:1.0:1783947693.250512:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319956224 00000100:00100000:1.0:1783947693.250529:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783947693.250536:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+17:14182:x1870604319956224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947693.250677:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e11f6c7-2161-442e-ac38-f4342317f92b+17:14182:x1870604319956224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947693.250683:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783947693.251827:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c83374700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319956224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783947693.255544:0:16271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1783947693.257795:0:14182:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1783947693.257828:0:14182:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783947693.257840:0:14182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631000/0x20c3e53e78bb314b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb3152 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947693.257852:0:14182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631000/0x20c3e53e78bb314b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb3152 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947693.257873:0:14182:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783947693.257876:0:14182:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3c88436800 from 10 10000000:01000000:3.0:1783947693.257879:0:14182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783947693.257913:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ae00/0x20c3e53e78bb3159 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947693.257922:0:14182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ae00/0x20c3e53e78bb3159 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947693.257932:0:14182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ae00/0x20c3e53e78bb3159 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947693.257957:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319956352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947693.258016:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947693.258789:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85bf7900 going to sleep for 11 seconds 00000100:00100000:2.0:1783947693.259843:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319956352 00000100:00100000:2.0:1783947693.259858:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319956352 00000100:00100000:2.0:1783947693.259921:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783947693.259931:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+17:14182:x1870604319956352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947693.259948:0:14177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947693.259965:0:14177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cc0631800/0x20c3e53e78bb3160 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb3159 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947693.260010:0:14177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cc0631800/0x20c3e53e78bb3160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb3159 expref: 18 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947693.260022:0:14177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cc0631800/0x20c3e53e78bb3160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb3159 expref: 18 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947693.260037:0:14177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0631800, rc 0) 00000100:00100000:2.0:1783947693.260098:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+18:14182:x1870604319956352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (2080us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947693.260543:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319956352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947693.260561:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ae00/0x20c3e53e78bb3159 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb3160 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947693.260571:0:14182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ae00/0x20c3e53e78bb3159 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb3160 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947693.260648:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319956480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947693.260687:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947693.260718:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783947693.260733:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c85bf7900 going to sleep for 11 seconds 00000100:00100000:3.0:1783947693.260753:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319956480 00000100:00100000:3.0:1783947693.260758:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319956480 00000100:00100000:3.0:1783947693.260796:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783947693.260804:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+18:14182:x1870604319956480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947693.261067:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+18:14182:x1870604319956480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947693.261074:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783947693.261086:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319956480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947693.261623:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319956608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947693.261724:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947693.261745:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c880d0000 going to sleep for 11 seconds 00000100:00100000:2.0:1783947693.261759:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319956608 00000100:00100000:2.0:1783947693.261763:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319956608 00000100:00100000:2.0:1783947693.261955:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783947693.261966:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+18:14182:x1870604319956608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947693.262243:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e11f6c7-2161-442e-ac38-f4342317f92b+18:14182:x1870604319956608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 280us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947693.262251:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783947693.262491:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319956608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783947693.263316:0:16274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1783947693.263703:0:14182:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1783947693.263726:0:14182:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783947693.263736:0:14182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ae00/0x20c3e53e78bb3159 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb3160 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947693.263746:0:14182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3ca9d1ae00/0x20c3e53e78bb3159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb3160 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947693.263756:0:14182:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783947693.263758:0:14182:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b3cbd9ce000 from 10 10000000:01000000:2.0:1783947693.263761:0:14182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783947693.263793:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb3167 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947693.263801:0:14182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb3167 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947693.263811:0:14182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb3167 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947693.263842:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319956736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783947693.263904:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947693.263937:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c880d0780 going to sleep for 11 seconds 00000100:00100000:2.0:1783947693.264598:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319956736 00000100:00100000:2.0:1783947693.264606:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319956736 00000100:00100000:2.0:1783947693.264653:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783947693.264662:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c866fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+18:14182:x1870604319956736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947693.264675:0:14178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947693.264689:0:14178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3cc0630800/0x20c3e53e78bb316e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20c3e53e78bb3167 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947693.264712:0:14178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3cc0630800/0x20c3e53e78bb316e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20c3e53e78bb3167 expref: 19 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947693.264723:0:14178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3cc0630800/0x20c3e53e78bb316e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20c3e53e78bb3167 expref: 19 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947693.264732:0:14178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630800, rc 0) 00000100:00100000:2.0:1783947693.264790:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c866fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+19:14182:x1870604319956736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947693.264798:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783947693.264846:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319956736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947693.264860:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb3167 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb316e expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947693.264880:0:14182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb3167 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20c3e53e78bb316e expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947693.264942:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319956864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947693.264975:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947693.265010:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c880d0780 going to sleep for 11 seconds 00000100:00100000:2.0:1783947693.265023:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319956864 00000100:00100000:2.0:1783947693.265026:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319956864 00000100:00100000:2.0:1783947693.265049:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783947693.265056:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+19:14182:x1870604319956864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947693.266102:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+19:14182:x1870604319956864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1044us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947693.266166:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783947693.266222:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319956864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947693.266399:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319956992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947693.266464:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947693.266632:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c880d0780 going to sleep for 11 seconds 00000100:00100000:3.0:1783947693.266666:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319956992 00000100:00100000:3.0:1783947693.266671:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319956992 00000100:00100000:3.0:1783947693.266737:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783947693.266746:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+19:14182:x1870604319956992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947693.266902:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+19:14182:x1870604319956992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947693.266909:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783947693.267059:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9e11f6c7-2161-442e-ac38-f4342317f92b:14182:1870604319956992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783947693.268078:0:16275:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1783947693.268311:0:14182:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1783947693.268345:0:14182:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783947693.268355:0:14182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb3167 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb316e expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947693.268366:0:14182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff8b3cc0631c00/0x20c3e53e78bb3167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20c3e53e78bb316e expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947693.765990:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947693.767454:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297944064 00000100:00100000:0.0:1783947693.767466:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297944064 00000100:00100000:0.0:1783947693.767537:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 115 00000100:00100000:0.0:1783947693.767547:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6916452-685c-4987-9050-344ce2627597+11:13737:x1870604297944064:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947693.767566:0:14179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947693.767584:0:14179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c87948a00/0x20c3e53e78bb3175 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab464 expref: -99 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947693.767628:0:14179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c87948a00/0x20c3e53e78bb3175 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab464 expref: 12 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947693.767639:0:14179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c87948a00/0x20c3e53e78bb3175 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab464 expref: 12 pid: 14179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947693.767648:0:14179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c87948a00, rc 0) 00000100:00100000:0.0:1783947693.767718:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6916452-685c-4987-9050-344ce2627597+12:13737:x1870604297944064:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 172us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947693.767724:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 115 00000100:00100000:0.0:1783947693.774925:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947693.775063:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297944192 00000100:00100000:2.0:1783947693.775072:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297944192 00000100:00100000:2.0:1783947693.775136:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 116 00000100:00100000:2.0:1783947693.775154:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+12:13737:x1870604297944192:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947693.775478:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6916452-685c-4987-9050-344ce2627597+12:13737:x1870604297944192:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 325us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947693.775487:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 116 00000100:00100000:2.0:1783947693.778510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947693.778851:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297944320 00000100:00100000:0.0:1783947693.778860:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297944320 00000100:00100000:0.0:1783947693.778986:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:0.0:1783947693.778997:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6916452-685c-4987-9050-344ce2627597+12:13737:x1870604297944320:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947693.780091:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6916452-685c-4987-9050-344ce2627597+12:13737:x1870604297944320:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 1083us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947693.780103:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:1.0:1783947693.794368:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947693.794802:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297944448 00000100:00100000:0.0:1783947693.794811:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297944448 00000100:00100000:0.0:1783947693.794965:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00100000:0.0:1783947693.794976:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+12:13737:x1870604297944448:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947693.794992:0:14177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947693.795009:0:14177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b3c87949200/0x20c3e53e78bb317c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab46b expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947693.795050:0:14177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b3c87949200/0x20c3e53e78bb317c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab46b expref: 13 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947693.795061:0:14177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b3c87949200/0x20c3e53e78bb317c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab46b expref: 13 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947693.795071:0:14177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c87949200, rc 0) 00000100:00100000:0.0:1783947693.795145:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+13:13737:x1870604297944448:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 162us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947693.795154:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00100000:0.0:1783947693.801301:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947693.801393:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297944576 00000100:00100000:3.0:1783947693.801403:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297944576 00000100:00100000:3.0:1783947693.801536:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 119 00000100:00100000:3.0:1783947693.801547:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6916452-685c-4987-9050-344ce2627597+13:13737:x1870604297944576:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947693.802412:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6916452-685c-4987-9050-344ce2627597+13:13737:x1870604297944576:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 863us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947693.802464:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 119 00000100:00100000:1.0:1783947693.808272:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947693.808351:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297944704 00000100:00100000:3.0:1783947693.808362:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297944704 00000100:00100000:3.0:1783947693.808540:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 120 00000100:00100000:3.0:1783947693.808553:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+13:13737:x1870604297944704:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947693.808787:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6916452-685c-4987-9050-344ce2627597+13:13737:x1870604297944704:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 237us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947693.808796:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 120 00010000:00010000:1.0:1783947694.009695:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947695.035302:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947695.077104:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947695.077228:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297944832 00000100:00100000:1.0:1783947695.077239:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297944832 00000100:00100000:1.0:1783947695.077332:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:1.0:1783947695.077343:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+6:14394:x1870604297944832:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947695.077365:0:14186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947695.077398:0:14186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb3183 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab472 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.077497:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb318a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783947695.077499:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783947695.077526:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb318a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.077537:0:14186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb318a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.077552:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb3191 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.077559:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb3191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.077565:0:14186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb3191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078044:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb3198 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078054:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb3198 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078061:0:14186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb3198 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947695.078147:0:14186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1783947695.078151:0:14186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783947695.078240:0:14186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb3198 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078262:0:14186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb318a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078277:0:14186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb318a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078284:0:14186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb318a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078290:0:14186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947695.078294:0:14186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb318a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078300:0:14186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb318a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078312:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3ca1587c00) 00010000:00010000:1.0:1783947695.078315:0:14186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947695.078319:0:14186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb318a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078326:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb318a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078339:0:14186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb3191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078345:0:14186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb3191 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078352:0:14186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb3191 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078356:0:14186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73bc00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947695.078365:0:14186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb3191 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078371:0:14186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb3191 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078379:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8b3ca1587f00) 00010000:00010000:1.0:1783947695.078381:0:14186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947695.078384:0:14186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb3191 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078389:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb3191 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078473:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a600/0x20c3e53e78bb3183 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab472 expref: 8 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078487:0:14186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a800/0x20c3e53e78bb3198 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab472 expref: 7 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.078494:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b3ca1587000) 00010000:00010000:1.0:1783947695.078497:0:14186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947695.078499:0:14186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a800, rc 0) 00000100:00100000:1.0:1783947695.078567:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+7:14394:x1870604297944832:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 1226us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947695.078576:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:3.0:1783947695.083230:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947695.083481:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297945088 00000100:00100000:2.0:1783947695.083496:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297945088 00000100:00100000:2.0:1783947695.083792:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:2.0:1783947695.083806:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+7:14394:x1870604297945088:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947695.083838:0:14184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947695.083871:0:14184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb319f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab479 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.083971:0:14184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31a6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.083990:0:14184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.084005:0:14184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.087226:0:14184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31ad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.087256:0:14184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.087271:0:14184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.087835:0:14184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb31b4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.087847:0:14184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb31b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.087863:0:14184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb31b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947695.087875:0:14184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1783947695.088123:0:14184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.088131:0:14184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31a6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.088137:0:14184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31a6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.088142:0:14184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630a00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947695.088146:0:14184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31a6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.088152:0:14184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31a6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.088164:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b3ca1587000) 00010000:00010000:2.0:1783947695.088167:0:14184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947695.088171:0:14184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31a6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.088177:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31a6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.088188:0:14184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.088194:0:14184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31ad lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.088207:0:14184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31ad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.088212:0:14184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947695.088215:0:14184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31ad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.088221:0:14184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31ad lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.088229:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8b3c84bc6800) 00010000:00010000:2.0:1783947695.088231:0:14184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947695.088234:0:14184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31ad lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.088240:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31ad lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.088671:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb319f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab479 expref: 10 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.088816:0:14184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630200/0x20c3e53e78bb31b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab479 expref: 9 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.088824:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b3c84bc6b00) 00010000:00010000:2.0:1783947695.088827:0:14184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947695.088829:0:14184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630200, rc 0) 00000100:00100000:2.0:1783947695.088900:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+9:14394:x1870604297945088:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 5097us (5685us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783947695.088919:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:2.0:1783947695.101530:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947695.101649:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297945216 00000100:00100000:1.0:1783947695.101668:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297945216 00000100:00100000:1.0:1783947695.101790:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:1.0:1783947695.101805:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+9:14394:x1870604297945216:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1783947695.102004:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+9:14394:x1870604297945216:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 Request processed in 202us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947695.102013:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:0.0:1783947695.128674:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947695.128973:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297945344 00000100:00100000:2.0:1783947695.128983:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297945344 00000100:00100000:2.0:1783947695.129044:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:2.0:1783947695.129054:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+9:14400:x1870604297945344:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1783947695.129074:0:14184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947695.129094:0:14184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb31c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab480 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.129165:0:14184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.129180:0:14184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.129190:0:14184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.129204:0:14184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.129211:0:14184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.129216:0:14184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.130368:0:14184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.130388:0:14184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.130396:0:14184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.130492:0:14184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947695.130497:0:14184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.130505:0:14184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.130520:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3ca1587c00) 00010000:00010000:2.0:1783947695.130523:0:14184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947695.130528:0:14184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.130534:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb31c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.130549:0:14184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.130555:0:14184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.130562:0:14184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.130567:0:14184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630a00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947695.130577:0:14184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.130584:0:14184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.130593:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8b3c84bc6800) 00010000:00010000:2.0:1783947695.130596:0:14184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947695.130599:0:14184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.130605:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb31d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.130649:0:14184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb31c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab480 expref: 10 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.130660:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3ca1587c00) 00010000:00010000:2.0:1783947695.130663:0:14184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947695.130667:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb31c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab480 expref: 10 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.130676:0:14184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630000, rc 0) 00000100:00100000:2.0:1783947695.130951:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+9:14400:x1870604297945344:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1896us (2329us total) trans 0 rc 301/301 00000100:00100000:2.0:1783947695.130960:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:3.0:1783947695.135332:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947695.136227:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297945472 00000100:00100000:0.0:1783947695.136242:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297945472 00000100:00100000:0.0:1783947695.136327:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:0.0:1783947695.136501:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+9:14400:x1870604297945472:12345-192.168.203.32@tcp:700:lfs.0 00000100:00100000:0.0:1783947695.136844:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+9:14400:x1870604297945472:12345-192.168.203.32@tcp:700:lfs.0 Request processed in 505us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947695.136854:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1783947695.141911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947695.142700:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297945728 00000100:00100000:2.0:1783947695.142716:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297945728 00000100:00100000:2.0:1783947695.142856:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:2.0:1783947695.142869:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+9:14400:x1870604297945728:12345-192.168.203.32@tcp:36:lfs.0 00010000:00010000:2.0:1783947695.142988:0:14185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947695.143024:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ae00/0x20c3e53e78bb3105 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab3fb expref: 9 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.143049:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3ca1587c00) 00010000:00010000:2.0:1783947695.143055:0:14185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947695.143500:0:14185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb31d7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.143520:0:14185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1b200/0x20c3e53e78bb313d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab45d expref: 5 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.143531:0:14185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb31d7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.143606:0:14185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1b200/0x20c3e53e78bb313d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab45d expref: 5 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.143625:0:14185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1b200/0x20c3e53e78bb313d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab45d expref: 5 pid: 14186 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947695.143643:0:14185:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c31f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1870604319957120:192.168.203.32@tcp:104: 00000100:00100000:2.0:1783947695.143790:0:14185:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3ca02af780 going to sleep for 11 seconds 00000100:00100000:1.0:1783947695.146495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947695.146838:0:14185:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c31f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1870604319957120:192.168.203.32@tcp:104: 00010000:00010000:2.0:1783947695.146877:0:14185:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb31d7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947695.149781:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297945856 00000100:00100000:3.0:1783947695.149803:0:16214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297945856 00010000:00010000:3.0:1783947695.149944:0:16214:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1b200/0x20c3e53e78bb313d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab45d expref: 6 pid: 14186 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947695.149998:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:3.0:1783947695.150009:0:16214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+6:2353:x1870604297945856:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947695.150030:0:16214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947695.150039:0:16214:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1b200/0x20c3e53e78bb313d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab45d expref: 6 pid: 14186 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.150054:0:16214:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1b200/0x20c3e53e78bb313d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab45d expref: 6 pid: 14186 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.150083:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1b200/0x20c3e53e78bb313d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab45d expref: 6 pid: 14186 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.150126:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3ca1587c00) 00010000:00010000:3.0:1783947695.150132:0:16214:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb31d7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.150142:0:16214:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb31d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.150151:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb31d7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.150196:0:16214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947695.150296:0:16214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+5:2353:x1870604297945856:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 288us (3816us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947695.150305:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00010000:00010000:1.0:1783947695.152204:0:14185:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb31d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.152225:0:14185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb31d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.152281:0:14185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb31de lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.152297:0:14185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb31de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.152311:0:14185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb31de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783947695.155186:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1783947695.155358:0:14185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783947695.155381:0:14185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb31d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.155394:0:14185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb31d7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.155402:0:14185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb31d7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.155409:0:14185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947695.155414:0:14185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb31d7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.155454:0:14185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb31d7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.155479:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3ca1587c00) 00010000:00010000:1.0:1783947695.155483:0:14185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947695.155491:0:14185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb31d7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.155498:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb31d7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947695.155526:0:14185:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f4550fcb reply state 000000000fed2d35 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb31de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947695.155537:0:14185:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783947695.155678:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+10:14400:x1870604297945728:12345-192.168.203.32@tcp:36:lfs.0 Request processed in 12805us (13779us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1783947695.155689:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00010000:00010000:1.0:1783947695.162106:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb31de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.162129:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb31de lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.162137:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb31de lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.162144:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73bc00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947695.162150:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb31de lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.162178:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb31de lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.162198:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8b3ca1587f00) 00010000:00010000:1.0:1783947695.162201:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947695.162205:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb31de lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.162211:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb31de lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947695.238159:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947695.238602:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297945984 00000100:00100000:1.0:1783947695.238616:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297945984 00000100:00100000:1.0:1783947695.238696:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:1.0:1783947695.238714:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+9:14408:x1870604297945984:12345-192.168.203.32@tcp:101:lctl.0 00010000:00010000:1.0:1783947695.238749:0:14186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947695.238779:0:14186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb31e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab487 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.239238:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb31ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.239267:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb31ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.239281:0:14186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb31ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947695.239365:0:14186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783947695.239389:0:14186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1783947695.240771:0:14186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb31ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.240838:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73bc00/0x20c3e53e78bb31e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab487 expref: 11 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.240883:0:14186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a400/0x20c3e53e78bb31ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab487 expref: 10 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.240893:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3ca1587f00) 00010000:00010000:0.0:1783947695.240897:0:14186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947695.240900:0:14186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a400, rc 0) 00000100:00100000:0.0:1783947695.241337:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+10:14408:x1870604297945984:12345-192.168.203.32@tcp:101:lctl.0 Request processed in 2627us (3188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947695.241349:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:0.0:1783947695.278858:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947695.279190:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297946112 00000100:00100000:1.0:1783947695.279204:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297946112 00000100:00100000:1.0:1783947695.279345:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:1.0:1783947695.279367:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+5:14409:x1870604297946112:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1783947695.279395:0:14185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947695.279456:0:14185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73be00/0x20c3e53e78bb31f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab48e expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.279549:0:14185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b800/0x20c3e53e78bb31fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.279567:0:14185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b800/0x20c3e53e78bb31fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.279581:0:14185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b800/0x20c3e53e78bb31fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947695.279674:0:14185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783947695.279680:0:14185:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1783947695.279711:0:14185:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b800/0x20c3e53e78bb31fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.279741:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73be00/0x20c3e53e78bb31f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab48e expref: 7 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.279763:0:14185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b800/0x20c3e53e78bb31fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab48e expref: 6 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.279774:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3ca1587f00) 00010000:00010000:1.0:1783947695.279791:0:14185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947695.279796:0:14185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73b800, rc 0) 00000100:00100000:1.0:1783947695.279884:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+6:14409:x1870604297946112:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 520us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947695.279892:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:3.0:1783947695.288859:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947695.289365:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297946240 00000100:00100000:0.0:1783947695.289380:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297946240 00000100:00100000:0.0:1783947695.289746:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:0.0:1783947695.289769:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+6:14409:x1870604297946240:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1783947695.289800:0:14186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947695.289829:0:14186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949e00/0x20c3e53e78bb3201 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab495 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.289919:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948e00/0x20c3e53e78bb3208 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.289939:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948e00/0x20c3e53e78bb3208 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.289955:0:14186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948e00/0x20c3e53e78bb3208 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.290009:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb320f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.290019:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb320f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.290027:0:14186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb320f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.291921:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb3216 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.291945:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb3216 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.291959:0:14186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb3216 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947695.292031:0:14186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1783947695.292035:0:14186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783947695.292065:0:14186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb3216 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.292079:0:14186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948e00/0x20c3e53e78bb3208 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.292085:0:14186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948e00/0x20c3e53e78bb3208 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.292093:0:14186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948e00/0x20c3e53e78bb3208 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.292115:0:14186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c87948e00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947695.292119:0:14186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948e00/0x20c3e53e78bb3208 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.292126:0:14186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948e00/0x20c3e53e78bb3208 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.292140:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3ca1587f00) 00010000:00010000:0.0:1783947695.292143:0:14186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947695.292147:0:14186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948e00/0x20c3e53e78bb3208 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.292154:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948e00/0x20c3e53e78bb3208 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.292168:0:14186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb320f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.292184:0:14186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb320f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.292190:0:14186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb320f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.292195:0:14186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c87949400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947695.292198:0:14186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb320f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.292204:0:14186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb320f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.292223:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8b3c8281b700) 00010000:00010000:0.0:1783947695.292225:0:14186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947695.292228:0:14186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb320f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.292234:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb320f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.292287:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949e00/0x20c3e53e78bb3201 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab495 expref: 8 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.292301:0:14186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb3216 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab495 expref: 7 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.292308:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8b3c8281b000) 00010000:00010000:0.0:1783947695.292310:0:14186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947695.292312:0:14186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c87948400, rc 0) 00000100:00100000:0.0:1783947695.294392:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+7:14409:x1870604297946240:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 4616us (5537us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947695.294405:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:2.0:1783947695.298132:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947695.298762:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297946496 00000100:00100000:1.0:1783947695.298777:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297946496 00000100:00100000:1.0:1783947695.298916:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:1.0:1783947695.298929:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+7:14409:x1870604297946496:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1783947695.298962:0:14185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947695.298992:0:14185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ba00/0x20c3e53e78bb321d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab49c expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947695.299159:0:14185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783947695.299320:0:14185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ba00/0x20c3e53e78bb321d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab49c expref: 9 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.299338:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3ca1587f00) 00010000:00010000:1.0:1783947695.299341:0:14185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947695.299346:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ba00/0x20c3e53e78bb321d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab49c expref: 9 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.299364:0:14185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73ba00, rc 0) 00000100:00100000:1.0:1783947695.299524:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+8:14409:x1870604297946496:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 598us (1935us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1783947695.299534:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:0.0:1783947695.309745:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947695.311220:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297946752 00000100:00100000:2.0:1783947695.311239:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297946752 00000100:00100000:2.0:1783947695.311346:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:2.0:1783947695.311368:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+8:14409:x1870604297946752:12345-192.168.203.32@tcp:36:lfs.0 00010000:00010000:2.0:1783947695.311867:0:14186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947695.311905:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb3216 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab495 expref: 8 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.311930:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8b3c8281b000) 00010000:00010000:2.0:1783947695.311945:0:14186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947695.311980:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb322b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.311996:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb322b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.312009:0:14186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb322b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783947695.312393:0:14186:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000393f7184 reply state 00000000c428d965 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb322b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947695.312859:0:14186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783947695.312884:0:14186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1783947695.313158:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+9:14409:x1870604297946752:12345-192.168.203.32@tcp:36:lfs.0 Request processed in 1789us (3423us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1783947695.313168:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:0.0:1783947695.320449:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947695.320531:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297947008 00000100:00100000:2.0:1783947695.320545:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297947008 00000100:00100000:2.0:1783947695.320623:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:2.0:1783947695.320654:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+9:14409:x1870604297947008:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1783947695.320966:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+10:14409:x1870604297947008:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 315us (564us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1783947695.320975:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00010000:00010000:1.0:1783947695.321171:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb322b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.321192:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb322b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.321201:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb322b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.321208:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947695.321214:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb322b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.321223:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb322b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.321251:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8b3c84bc6800) 00010000:00010000:1.0:1783947695.321254:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1783947695.321260:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb322b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.321267:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb322b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947695.328313:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947695.328470:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297947264 00000100:00100000:1.0:1783947695.328484:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297947264 00000100:00100000:1.0:1783947695.328567:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:1.0:1783947695.328578:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+9:14409:x1870604297947264:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1783947695.328882:0:14185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947695.328912:0:14185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ba00/0x20c3e53e78bb3232 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab4a3 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329015:0:14185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb3239 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329052:0:14185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb3239 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329066:0:14185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb3239 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329085:0:14185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3240 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329092:0:14185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3240 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329099:0:14185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3240 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947695.329275:0:14185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783947695.329390:0:14185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb3239 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329409:0:14185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb3239 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329481:0:14185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb3239 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329489:0:14185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947695.329495:0:14185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb3239 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329503:0:14185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb3239 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329530:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3ca1587f00) 00010000:00010000:1.0:1783947695.329533:0:14185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947695.329539:0:14185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb3239 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329546:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb3239 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329719:0:14185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3240 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329726:0:14185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3240 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329733:0:14185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3240 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329739:0:14185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947695.329742:0:14185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3240 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329749:0:14185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3240 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329758:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8b3ca1587c00) 00010000:00010000:1.0:1783947695.329760:0:14185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947695.329763:0:14185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3240 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329769:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3240 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329828:0:14185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ba00/0x20c3e53e78bb3232 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4a3 expref: 11 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329839:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3ca1587f00) 00010000:00010000:1.0:1783947695.329842:0:14185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947695.329845:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ba00/0x20c3e53e78bb3232 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4a3 expref: 11 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.329854:0:14185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73ba00, rc 0) 00000100:00100000:1.0:1783947695.329929:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+10:14409:x1870604297947264:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1353us (1633us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1783947695.329938:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:0.0:1783947695.334242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947695.334342:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297947392 00000100:00100000:2.0:1783947695.334355:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297947392 00000100:00100000:2.0:1783947695.334456:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:2.0:1783947695.334467:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+10:14409:x1870604297947392:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1783947695.334495:0:14186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947695.334522:0:14186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb324e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab4aa expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.334751:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3255 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.334767:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3255 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.334781:0:14186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3255 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947695.334843:0:14186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783947695.334847:0:14186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783947695.334868:0:14186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3255 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.334896:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb324e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4aa expref: 12 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.334938:0:14186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3255 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4aa expref: 11 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.334948:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:2.0:1783947695.334951:0:14186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947695.334955:0:14186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630a00, rc 0) 00000100:00100000:2.0:1783947695.335026:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+11:14409:x1870604297947392:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 561us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947695.335033:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:0.0:1783947695.340034:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947695.340120:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297947520 00000100:00100000:2.0:1783947695.340133:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297947520 00000100:00100000:2.0:1783947695.340207:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:2.0:1783947695.340220:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+11:14409:x1870604297947520:12345-192.168.203.32@tcp:37:lfs.0 00000040:00080000:2.0:1783947695.354209:0:14219:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783947695.355202:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+11:14409:x1870604297947520:12345-192.168.203.32@tcp:37:lfs.0 Request processed in 14973us (15173us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947695.355218:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:0.0:1783947695.362916:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947695.363020:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297947776 00000100:00100000:3.0:1783947695.363036:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297947776 00000100:00100000:3.0:1783947695.363112:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:3.0:1783947695.363124:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cc0a49050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+11:14409:x1870604297947776:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1783947695.363535:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cc0a49050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+12:14409:x1870604297947776:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 412us (634us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1783947695.363545:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:0.0:1783947695.422658:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947695.426477:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297947904 00000100:00100000:1.0:1783947695.426498:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297947904 00000100:00100000:1.0:1783947695.426599:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:1.0:1783947695.426612:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+10:14415:x1870604297947904:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1783947695.426641:0:14185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947695.426669:0:14185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ba00/0x20c3e53e78bb325c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab4b1 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.426759:0:14185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3263 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.426776:0:14185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3263 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.426790:0:14185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3263 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.426826:0:14185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb326a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.426834:0:14185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb326a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.426842:0:14185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb326a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.426985:0:14185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b200/0x20c3e53e78bb3271 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.426995:0:14185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b200/0x20c3e53e78bb3271 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.427002:0:14185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b200/0x20c3e53e78bb3271 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947695.428188:0:14185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1783947695.428197:0:14185:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783947695.428662:0:14185:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b200/0x20c3e53e78bb3271 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.428684:0:14185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3263 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.428691:0:14185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3263 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.428699:0:14185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3263 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.428725:0:14185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947695.428730:0:14185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3263 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.428739:0:14185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3263 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.428758:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3ca1587f00) 00010000:00010000:1.0:1783947695.428762:0:14185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947695.428767:0:14185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3263 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.428774:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b600/0x20c3e53e78bb3263 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.428792:0:14185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb326a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.428799:0:14185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb326a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.428804:0:14185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb326a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.428809:0:14185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947695.428812:0:14185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb326a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.428818:0:14185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb326a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.428840:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8b3ca1587c00) 00010000:00010000:1.0:1783947695.428843:0:14185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947695.428846:0:14185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb326a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.428852:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb326a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.428906:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73ba00/0x20c3e53e78bb325c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4b1 expref: 12 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.428924:0:14185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73b200/0x20c3e53e78bb3271 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4b1 expref: 11 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.428931:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:1.0:1783947695.428933:0:14185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783947695.428936:0:14185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73b200, rc 0) 00000100:00100000:1.0:1783947695.429515:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+11:14415:x1870604297947904:12345-192.168.203.32@tcp:101:bash.0 Request processed in 2900us (7096us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947695.429527:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:1.0:1783947695.438489:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947695.438576:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297948160 00000100:00100000:3.0:1783947695.438591:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297948160 00000100:00100000:3.0:1783947695.438667:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:3.0:1783947695.438678:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+11:14415:x1870604297948160:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1783947695.438725:0:14184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947695.438759:0:14184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1b200/0x20c3e53e78bb3278 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab4b8 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.438944:0:14184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb327f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.438963:0:14184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3255 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4aa expref: 11 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.438973:0:14184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb327f lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.439013:0:14184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3255 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4aa expref: 11 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.439026:0:14184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3255 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4aa expref: 11 pid: 14186 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947695.439047:0:14184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85bc4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14184:1870604319957248:192.168.203.32@tcp:104: 00000100:00100000:3.0:1783947695.439165:0:14184:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c882b0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783947695.441371:0:14184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85bc4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14184:1870604319957248:192.168.203.32@tcp:104: 00010000:00010000:3.0:1783947695.442181:0:14184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb327f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947695.442785:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947695.443011:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297948288 00000100:00100000:0.0:1783947695.443025:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297948288 00010000:00010000:0.0:1783947695.443154:0:14171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3255 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4aa expref: 12 pid: 14186 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947695.443239:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:0.0:1783947695.443260:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83374e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+12:2353:x1870604297948288:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947695.443285:0:14171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947695.443295:0:14171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3255 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4aa expref: 12 pid: 14186 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.443310:0:14171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3255 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4aa expref: 12 pid: 14186 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.443343:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3255 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4aa expref: 12 pid: 14186 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.443365:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:0.0:1783947695.443370:0:14171:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb327f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.443381:0:14171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb327f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.443391:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb327f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.443482:0:14171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947695.443572:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83374e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+11:2353:x1870604297948288:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 313us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947695.443601:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00010000:00010000:3.0:1783947695.443834:0:14184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb327f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.443843:0:14184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb327f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.445559:0:14184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb3286 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.445581:0:14184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb3286 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.445594:0:14184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb3286 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.447007:0:14184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb328d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.447024:0:14184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb328d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.447034:0:14184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb328d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947695.447056:0:14184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783947695.447086:0:14184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb327f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.447093:0:14184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb327f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.447100:0:14184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb327f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.447107:0:14184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1aa00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947695.447113:0:14184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb327f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.447134:0:14184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb327f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.447148:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:3.0:1783947695.447151:0:14184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947695.447157:0:14184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb327f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.447163:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1aa00/0x20c3e53e78bb327f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783947695.447177:0:14184:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000034c679d9 reply state 00000000c61a0a5d transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb3286 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947695.447186:0:14184:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783947695.447223:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1b200/0x20c3e53e78bb3278 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4b8 expref: 14 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.447238:0:14184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb328d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4b8 expref: 13 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.447300:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b3c98198f00) 00010000:00010000:3.0:1783947695.447302:0:14184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1783947695.447305:0:14184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671e00, rc 0) 00000100:00100000:3.0:1783947695.447632:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+14:14415:x1870604297948160:12345-192.168.203.32@tcp:101:bash.0 Request processed in 8953us (9157us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1783947695.447642:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 28 00010000:00010000:2.0:1783947695.450184:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb3286 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.450208:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb3286 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.450217:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb3286 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.450225:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3ca9d1a400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947695.450259:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb3286 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.450268:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb3286 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.450290:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8b3c98198800) 00010000:00010000:2.0:1783947695.450294:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947695.450299:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb3286 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.450306:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3ca9d1a400/0x20c3e53e78bb3286 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947695.474155:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947695.474332:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297948416 00000100:00100000:2.0:1783947695.474345:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297948416 00000100:00100000:2.0:1783947695.474482:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:2.0:1783947695.474498:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+13:14415:x1870604297948416:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1783947695.474687:0:14185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947695.474718:0:14185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb329b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab4bf expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.474812:0:14185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb32a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.474831:0:14185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb32a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.474845:0:14185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb32a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947695.474915:0:14185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783947695.474921:0:14185:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783947695.474950:0:14185:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb32a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.474963:0:14185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb32a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.474991:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb329b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4bf expref: 15 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.475013:0:14185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb32a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4bf expref: 14 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.475022:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b3c98198f00) 00010000:00010000:2.0:1783947695.475025:0:14185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947695.475029:0:14185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630000, rc 0) 00000100:00100000:2.0:1783947695.475281:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+14:14415:x1870604297948416:12345-192.168.203.32@tcp:101:bash.0 Request processed in 787us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947695.475290:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:3.0:1783947695.482171:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947695.482363:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297948672 00000100:00100000:2.0:1783947695.482377:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297948672 00000100:00100000:2.0:1783947695.482494:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:2.0:1783947695.482507:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+14:14415:x1870604297948672:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:2.0:1783947695.483029:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+15:14415:x1870604297948672:12345-192.168.203.32@tcp:35:bash.0 Request processed in 521us (869us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1783947695.483039:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:0.0:1783947695.590074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947695.590165:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297948928 00000100:00100000:3.0:1783947695.590195:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297948928 00000100:00100000:3.0:1783947695.590279:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:3.0:1783947695.590291:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+15:14425:x1870604297948928:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1783947695.590333:0:14184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947695.590363:0:14184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab4c6 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947695.590805:0:14184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1783947695.590962:0:14184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4c6 expref: 17 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.590981:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b3ca1587f00) 00010000:00010000:3.0:1783947695.590984:0:14184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783947695.590990:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4c6 expref: 17 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.591011:0:14184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c85671600, rc 0) 00000100:00100000:3.0:1783947695.591087:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+16:14425:x1870604297948928:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 797us (1027us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1783947695.591094:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:1.0:1783947695.594956:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947695.595072:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297949184 00000100:00100000:2.0:1783947695.595085:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297949184 00000100:00100000:2.0:1783947695.595491:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:2.0:1783947695.595503:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+16:14425:x1870604297949184:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1783947695.596203:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+17:14425:x1870604297949184:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 699us (1258us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1783947695.596213:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:1.0:1783947695.635890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947695.636002:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297949440 00000100:00100000:2.0:1783947695.636024:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297949440 00000100:00100000:2.0:1783947695.636110:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:2.0:1783947695.636131:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+17:14428:x1870604297949440:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1783947695.636178:0:14185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947695.636213:0:14185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb32b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab4cd expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.636356:0:14185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630400/0x20c3e53e78bb32be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.636375:0:14185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630400/0x20c3e53e78bb32be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.636389:0:14185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630400/0x20c3e53e78bb32be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947695.636403:0:14185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783947695.638180:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb32b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4cd expref: 20 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.638216:0:14185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630400/0x20c3e53e78bb32be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4cd expref: 19 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.638261:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b3c98198f00) 00010000:00010000:2.0:1783947695.638265:0:14185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947695.638269:0:14185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630400, rc 0) 00000100:00100000:2.0:1783947695.638380:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+19:14428:x1870604297949440:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 2258us (2503us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1783947695.638391:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:0.0:1783947695.647974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947695.648034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947695.648075:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297949696 00000100:00100000:0.0:1783947695.648087:0:16214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297949696 00000100:00100000:0.0:1783947695.649055:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:0.0:1783947695.649073:0:16214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd039500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+19:2354:x1870604297949696:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947695.649107:0:16214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947695.649145:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630400/0x20c3e53e78bb32be lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4cd expref: 19 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.649169:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b3c98198f00) 00010000:00010000:0.0:1783947695.649175:0:16214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947695.649389:0:16214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd039500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+18:2354:x1870604297949696:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 321us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947695.649410:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1783947695.650034:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297949568 00000100:00100000:3.0:1783947695.650045:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297949568 00000100:00100000:3.0:1783947695.650116:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:3.0:1783947695.650138:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+18:14428:x1870604297949568:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:3.0:1783947695.650232:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32cc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.650265:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.650290:0:14186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.650324:0:14186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.650331:0:14186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32cc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.650338:0:14186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.650345:0:14186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947695.650350:0:14186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.650358:0:14186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32cc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.650369:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b3c98198f00) 00010000:00010000:3.0:1783947695.650373:0:14186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783947695.650377:0:14186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32cc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947695.650383:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32cc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947695.650488:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+18:14428:x1870604297949568:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 362us (2525us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947695.650495:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:3.0:1783947695.652923:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947695.652986:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297949952 00000100:00100000:2.0:1783947695.653000:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297949952 00000100:00100000:2.0:1783947695.653079:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:2.0:1783947695.653092:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+18:14428:x1870604297949952:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1783947695.653627:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+19:14428:x1870604297949952:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 537us (716us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1783947695.653637:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:1.0:1783947695.673983:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947695.674016:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319957376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947695.674132:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947695.674277:0:14824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319957376 00000100:00100000:0.0:1783947695.674287:0:14824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319957376 00000100:00100000:0.0:1783947695.674368:0:14824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783947695.674379:0:14824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319957376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947695.674447:0:14824:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947695.674503:0:14824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319957376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (371us total) trans 0 rc 0/0 00000100:00080000:1.0:1783947695.674600:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947695.674660:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319957376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947695.674716:0:14824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947695.878153:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947695.878276:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947695.878314:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947695.878343:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947695.878369:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947695.878596:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297950208 00000100:00100000:2.0:1783947695.878611:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297950208 00000100:00100000:2.0:1783947695.878689:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297950336 00000100:00100000:2.0:1783947695.878694:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297950336 00000100:00100000:2.0:1783947695.878708:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297950464 00000100:00100000:2.0:1783947695.878711:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297950464 00000100:00100000:2.0:1783947695.878726:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297950592 00000100:00100000:2.0:1783947695.878728:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297950592 00000100:00100000:2.0:1783947695.878746:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:2.0:1783947695.878757:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+5:2355:x1870604297950208:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947695.878854:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+5:2355:x1870604297950208:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 98us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947695.878873:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:2.0:1783947695.878915:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:2.0:1783947695.878921:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+5:2356:x1870604297950336:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947695.878947:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+5:2356:x1870604297950336:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 26us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947695.878953:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:2.0:1783947695.878965:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:2.0:1783947695.878971:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+5:2355:x1870604297950464:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947695.878991:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+5:2355:x1870604297950464:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 21us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947695.878997:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:2.0:1783947695.879008:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:2.0:1783947695.879013:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+5:2356:x1870604297950592:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1783947695.879032:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dadc93e9-b617-4dbb-81a2-fd9a39f0423d+5:2356:x1870604297950592:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 19us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947695.879038:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00080000:3.0:1783947695.879170:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947695.879176:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947695.884793:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297950080 00000100:00100000:0.0:1783947695.885502:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297950080 00000100:00100000:0.0:1783947695.885783:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 121 00000100:00100000:0.0:1783947695.885798:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6916452-685c-4987-9050-344ce2627597+13:2356:x1870604297950080:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1783947695.886536:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6916452-685c-4987-9050-344ce2627597+13:2356:x1870604297950080:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 737us (8394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947695.887154:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 121 00000100:00100000:3.0:1783947695.942131:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947695.942312:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297950848 00000100:00100000:2.0:1783947695.942326:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297950848 00000100:00100000:2.0:1783947695.942412:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:2.0:1783947695.942467:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+19:14459:x1870604297950848:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:2.0:1783947695.942502:0:14185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947695.942529:0:14185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb32d3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab4d4 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.942820:0:14185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb32da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.942858:0:14185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb32da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.943497:0:14185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb32da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947695.943517:0:14185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783947695.944065:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb32d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4d4 expref: 22 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.944089:0:14185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb32da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4d4 expref: 21 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.944100:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b3c98198f00) 00010000:00010000:2.0:1783947695.944103:0:14185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947695.944108:0:14185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630c00, rc 0) 00000100:00100000:2.0:1783947695.944211:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+21:14459:x1870604297950848:12345-192.168.203.32@tcp:101:cat.0 Request processed in 1746us (2095us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1783947695.944221:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:2.0:1783947695.949974:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947695.950218:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297951104 00000100:00100000:0.0:1783947695.950231:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297951104 00000100:00100000:0.0:1783947695.950312:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:0.0:1783947695.950323:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+21:14459:x1870604297951104:12345-192.168.203.32@tcp:35:cat.0 00000100:00100000:1.0:1783947695.950943:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947695.951058:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297951232 00000100:00100000:2.0:1783947695.951064:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297951232 00000100:00100000:2.0:1783947695.951117:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:2.0:1783947695.951126:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83377b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+22:2354:x1870604297951232:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947695.951140:0:14170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947695.951170:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb32da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4d4 expref: 22 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947695.951214:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b3c98198f00) 00010000:00010000:2.0:1783947695.951220:0:14170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947695.951699:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83377b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+21:2354:x1870604297951232:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 570us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947695.951708:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:0.0:1783947695.952378:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+21:14459:x1870604297951104:12345-192.168.203.32@tcp:35:cat.0 Request processed in 2053us (2414us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1783947695.952390:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:1.0:1783947696.017107:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947696.024338:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297951488 00000100:00100000:0.0:1783947696.024360:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297951488 00000100:00100000:0.0:1783947696.024470:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:0.0:1783947696.024484:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+21:14465:x1870604297951488:12345-192.168.203.32@tcp:101:dd.0 00010000:00010000:0.0:1783947696.024521:0:14184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947696.024689:0:14184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948c00/0x20c3e53e78bb32e8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab4db expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.024833:0:14184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948000/0x20c3e53e78bb32ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.024850:0:14184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb328d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4b8 expref: 22 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.024882:0:14184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb32a2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4bf expref: 22 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.024891:0:14184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948000/0x20c3e53e78bb32ef lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.024943:0:14184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb32a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4bf expref: 22 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.024958:0:14184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb32a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4bf expref: 22 pid: 14185 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947696.024974:0:14184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd038000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14184:1870604319957504:192.168.203.32@tcp:104: 00010000:00010000:0.0:1783947696.026837:0:14184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb328d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4b8 expref: 22 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.026860:0:14184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb328d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4b8 expref: 22 pid: 14184 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947696.026877:0:14184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd039f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14184:1870604319957632:192.168.203.32@tcp:104: 00000100:00100000:0.0:1783947696.026943:0:14184:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c836106c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947696.034687:0:14184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd038000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14184:1870604319957504:192.168.203.32@tcp:104: 00000100:00100000:0.0:1783947696.034709:0:14184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd039f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14184:1870604319957632:192.168.203.32@tcp:104: 00010000:00010000:0.0:1783947696.034744:0:14184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948000/0x20c3e53e78bb32ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947696.034840:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947696.034891:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297951744 00000100:00100000:0.0:1783947696.034901:0:16214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297951744 00010000:00010000:0.0:1783947696.034947:0:16214:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb328d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4b8 expref: 23 pid: 14184 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947696.034961:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947696.041705:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297951616 00000100:00100000:0.0:1783947696.041726:0:16214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297951616 00010000:00010000:0.0:1783947696.041794:0:16214:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb32a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4bf expref: 24 pid: 14185 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947696.041842:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1783947696.041854:0:16214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbda25c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+24:2354:x1870604297951744:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947696.041874:0:16214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947696.041883:0:16214:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb328d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4b8 expref: 24 pid: 14184 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.041896:0:16214:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb328d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4b8 expref: 24 pid: 14184 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.041924:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671e00/0x20c3e53e78bb328d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4b8 expref: 24 pid: 14184 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.041950:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b3c98198f00) 00010000:00010000:0.0:1783947696.041957:0:16214:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948000/0x20c3e53e78bb32ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.041967:0:16214:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948000/0x20c3e53e78bb32ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.041994:0:16214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947696.042105:0:16214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbda25c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+23:2354:x1870604297951744:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 251us (7266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947696.042114:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1783947696.042175:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:0.0:1783947696.042182:0:16214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+22:2353:x1870604297951616:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947696.042191:0:16214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947696.042196:0:16214:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb32a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4bf expref: 22 pid: 14185 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.042207:0:16214:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb32a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4bf expref: 22 pid: 14185 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.042220:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb32a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4bf expref: 22 pid: 14185 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.042230:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b3c98198f00) 00010000:00010000:0.0:1783947696.042234:0:16214:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948000/0x20c3e53e78bb32ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.042252:0:16214:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948000/0x20c3e53e78bb32ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.042261:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948000/0x20c3e53e78bb32ef lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.042290:0:16214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947696.042325:0:16214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+21:2353:x1870604297951616:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 136us (7359us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947696.042333:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00010000:00010000:0.0:1783947696.042378:0:14184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948000/0x20c3e53e78bb32ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.042387:0:14184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948000/0x20c3e53e78bb32ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947696.042410:0:14184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783947696.042815:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948c00/0x20c3e53e78bb32e8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4db expref: 22 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.042835:0:14184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948000/0x20c3e53e78bb32ef lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4db expref: 21 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.042843:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b3c98198f00) 00010000:00010000:2.0:1783947696.042846:0:14184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783947696.042848:0:14184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c87948000, rc 0) 00000100:00100000:2.0:1783947696.042880:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+21:14465:x1870604297951488:12345-192.168.203.32@tcp:101:dd.0 Request processed in 18400us (25788us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1783947696.042887:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:2.0:1783947696.048236:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947696.048602:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297952000 00000100:00100000:3.0:1783947696.048617:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297952000 00000100:00100000:3.0:1783947696.048693:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:3.0:1783947696.048705:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+21:14465:x1870604297952000:12345-192.168.203.32@tcp:36:dd.0 00010000:00010000:3.0:1783947696.049072:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32fd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.049094:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.049109:0:14186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783947696.049180:0:14186:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1783947696.049223:0:14186:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003880d16c reply state 000000008a457f16 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947696.049234:0:14186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783947696.049378:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+24:14465:x1870604297952000:12345-192.168.203.32@tcp:36:dd.0 Request processed in 673us (1157us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1783947696.049386:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 35 00000020:00080000:3.0:1783947696.049658:0:14186:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783947696.051183:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.051205:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32fd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.051212:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.051237:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947696.051252:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.051262:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32fd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.051283:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b3c98198f00) 00010000:00010000:2.0:1783947696.051287:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947696.051292:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32fd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.051299:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c85671600/0x20c3e53e78bb32fd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947696.051579:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947696.051671:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297952128 00000100:00100000:2.0:1783947696.051686:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297952128 00000100:00100000:2.0:1783947696.051744:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:2.0:1783947696.051765:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+23:14465:x1870604297952128:12345-192.168.203.32@tcp:101:dd.0 00010000:00010000:2.0:1783947696.051795:0:14184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947696.051815:0:14184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb3304 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab4e2 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.051883:0:14184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb3304 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4e2 expref: 24 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.051897:0:14184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb3304 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4e2 expref: 24 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.051931:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b3c98198f00) 00010000:00010000:2.0:1783947696.051934:0:14184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947696.051937:0:14184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630c00, rc 0) 00000100:00100000:2.0:1783947696.052008:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+24:14465:x1870604297952128:12345-192.168.203.32@tcp:101:dd.0 Request processed in 243us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947696.052016:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 36 00010000:00010000:1.0:1783947696.057633:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947696.065905:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947696.066019:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297952384 00000100:00100000:0.0:1783947696.066033:0:16214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297952384 00000100:00100000:0.0:1783947696.066189:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:0.0:1783947696.066205:0:16214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+24:14465:x1870604297952384:12345-192.168.203.32@tcp:103:dd.0 00010000:00010000:0.0:1783947696.066227:0:16214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947696.066271:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb3304 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4e2 expref: 24 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.066308:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b3c98198f00) 00010000:00010000:0.0:1783947696.066322:0:16214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947696.066488:0:16214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+23:14465:x1870604297952384:12345-192.168.203.32@tcp:103:dd.0 Request processed in 210us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947696.066497:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:0.0:1783947696.069864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947696.070051:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297952512 00000100:00100000:2.0:1783947696.070066:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297952512 00000100:00100000:2.0:1783947696.070325:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:2.0:1783947696.070340:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+23:14465:x1870604297952512:12345-192.168.203.32@tcp:58:dd.0 00010000:00010000:2.0:1783947696.070554:0:14185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb330b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.070579:0:14185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb330b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.070593:0:14185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb330b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947696.071516:0:14185:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947696.071693:0:14185:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1783947696.071781:0:14185:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1783947696.071928:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+23:14465:x1870604297952512:12345-192.168.203.32@tcp:58:dd.0 Request processed in 1587us (2073us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947696.071941:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:3.0:1783947696.074386:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947696.074826:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297952640 00000100:00100000:2.0:1783947696.074839:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297952640 00000100:00100000:2.0:1783947696.074974:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:2.0:1783947696.074987:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+23:14465:x1870604297952640:12345-192.168.203.32@tcp:101:dd.0 00010000:00010000:2.0:1783947696.075016:0:14184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947696.075045:0:14184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3312 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab4e9 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.075134:0:14184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb330b lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.075148:0:14184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3312 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4e9 expref: 24 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.075171:0:14184:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb330b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.075187:0:14184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3312 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4e9 expref: 24 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.075202:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b3c98198f00) 00010000:00010000:2.0:1783947696.075206:0:14184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947696.075210:0:14184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3312 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4e9 expref: 24 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.075219:0:14184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630a00, rc 0) 00000100:00100000:2.0:1783947696.075310:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+24:14465:x1870604297952640:12345-192.168.203.32@tcp:101:dd.0 Request processed in 325us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947696.075318:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 38 00000040:00080000:2.0:1783947696.378263:0:14219:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783947696.378296:0:14219:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947696.378352:0:14219:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783947696.378359:0:14219:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783947696.378692:0:14219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c32a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14219:1870604319957760:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783947696.378849:0:14219:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c90e67300 going to sleep for 11 seconds 00000100:00100000:2.0:1783947696.383729:0:14219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c32a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14219:1870604319957760:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783947696.387762:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947696.390181:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297952768 00000100:00100000:3.0:1783947696.390272:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297952768 00000100:00100000:3.0:1783947696.390520:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1783947696.390535:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+24:14466:x1870604297952768:12345-192.168.203.32@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1783947696.390646:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+24:14466:x1870604297952768:12345-192.168.203.32@tcp:900:lhsmtool_posix.0 Request processed in 115us (2901us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947696.390654:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:0.0:1783947696.395381:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947696.395604:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297952896 00000100:00100000:2.0:1783947696.395620:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297952896 00000100:00100000:2.0:1783947696.395705:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:2.0:1783947696.395719:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+24:14466:x1870604297952896:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783947696.395777:0:14185:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783947696.395929:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+24:14466:x1870604297952896:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 212us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947696.395938:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:1.0:1783947696.402541:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947696.402612:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297953024 00000100:00100000:2.0:1783947696.402626:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297953024 00000100:00100000:2.0:1783947696.402955:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:2.0:1783947696.402969:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+24:14466:x1870604297953024:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783947696.403080:0:14184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb3319 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.403102:0:14184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb3319 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.403116:0:14184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb3319 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.408709:0:14184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb3320 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.408746:0:14184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb3320 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.408759:0:14184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb3320 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.408792:0:14184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb3327 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.408801:0:14184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb3327 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.408808:0:14184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb3327 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947696.408851:0:14184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783947696.408855:0:14184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783947696.408868:0:14184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb3327 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.408880:0:14184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb3319 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.408886:0:14184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb3319 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.408893:0:14184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb3319 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.408900:0:14184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0631600 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947696.408904:0:14184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb3319 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.408918:0:14184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb3319 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.408931:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b3c84bc6b00) 00010000:00010000:2.0:1783947696.408934:0:14184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947696.408939:0:14184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb3319 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.408946:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0631600/0x20c3e53e78bb3319 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.408960:0:14184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb3320 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.408965:0:14184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb3320 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.408970:0:14184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb3320 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.408974:0:14184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630c00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947696.408977:0:14184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb3320 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.408982:0:14184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb3320 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.408989:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8b3c84bc6300) 00010000:00010000:2.0:1783947696.408992:0:14184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947696.408994:0:14184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb3320 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.409011:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630c00/0x20c3e53e78bb3320 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.409028:0:14184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb3327 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.409034:0:14184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb3327 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.409040:0:14184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb3327 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.409046:0:14184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630000 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947696.409049:0:14184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb3327 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.409055:0:14184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb3327 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.409064:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b3c98198f00) 00010000:00010000:2.0:1783947696.409066:0:14184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947696.409069:0:14184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb3327 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.409075:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630000/0x20c3e53e78bb3327 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947696.409174:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+24:14466:x1870604297953024:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 Request processed in 6205us (6645us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947696.409184:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:1.0:1783947696.414838:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947696.414951:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297953280 00000100:00100000:2.0:1783947696.414964:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297953280 00000100:00100000:2.0:1783947696.415053:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:2.0:1783947696.415078:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+24:14466:x1870604297953280:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947696.415109:0:14185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947696.415136:0:14185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630400/0x20c3e53e78bb332e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab4f0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.415278:0:14185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3335 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.415297:0:14185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3335 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.415322:0:14185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3335 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947696.415335:0:14185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783947696.415523:0:14185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3335 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.415533:0:14185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3335 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.416606:0:14185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3335 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.416629:0:14185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147ca00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947696.416636:0:14185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3335 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.416647:0:14185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3335 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.416693:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b3c98198f00) 00010000:00010000:2.0:1783947696.416696:0:14185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783947696.416703:0:14185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3335 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.416710:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3335 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.416809:0:14185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630400/0x20c3e53e78bb332e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4f0 expref: 26 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.416823:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b3c84bc6b00) 00010000:00010000:2.0:1783947696.416825:0:14185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947696.416829:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630400/0x20c3e53e78bb332e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4f0 expref: 26 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.416840:0:14185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cc0630400, rc 0) 00000100:00100000:2.0:1783947696.416935:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+25:14466:x1870604297953280:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 1871us (2111us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1783947696.416946:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:0.0:1783947696.422734:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947696.422834:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297953408 00000100:00100000:2.0:1783947696.422848:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297953408 00000100:00100000:2.0:1783947696.422931:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:2.0:1783947696.422944:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+25:14466:x1870604297953408:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783947696.423004:0:14184:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783947696.423596:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+25:14466:x1870604297953408:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 650us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947696.423627:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:1.0:1783947696.428210:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947696.428412:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297953664 00000100:00100000:0.0:1783947696.428458:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297953664 00000100:00100000:0.0:1783947696.428567:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:0.0:1783947696.428601:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+25:14466:x1870604297953664:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947696.428633:0:14186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947696.428662:0:14186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb3343 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab4f7 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783947696.430302:0:14186:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:0.0:1783947696.430319:0:14186:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1783947696.430454:0:14186:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1783947696.430867:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948e00/0x20c3e53e78bb334a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.430889:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948e00/0x20c3e53e78bb334a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.430904:0:14186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948e00/0x20c3e53e78bb334a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.430994:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb3343 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4f7 expref: 28 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.431017:0:14186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948e00/0x20c3e53e78bb334a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4f7 expref: 27 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.431027:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b3c8281b700) 00010000:00010000:0.0:1783947696.431031:0:14186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947696.431034:0:14186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c87948e00, rc 0) 00000100:00100000:0.0:1783947696.431129:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+27:14466:x1870604297953664:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 2530us (2931us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1783947696.431140:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:0.0:1783947696.449148:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947696.449279:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297953920 00000100:00100000:1.0:1783947696.449292:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297953920 00000100:00100000:1.0:1783947696.449404:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:1.0:1783947696.449414:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+27:14466:x1870604297953920:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783947696.449554:0:14185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947696.449597:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948e00/0x20c3e53e78bb334a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4f7 expref: 27 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.449625:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b3c8281b700) 00010000:00010000:1.0:1783947696.449645:0:14185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783947696.449799:0:14185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb3358 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.449832:0:14185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb3358 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.449845:0:14185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb3358 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.451353:0:14185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb335f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xda1bae1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.451377:0:14185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb335f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda1bae1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.451390:0:14185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb335f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda1bae1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.451597:0:14185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb3358 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.451605:0:14185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb3358 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.451611:0:14185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb3358 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.451617:0:14185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c87949800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947696.451621:0:14185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb3358 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.451628:0:14185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb3358 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.451656:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8b3c84bc6600) 00010000:00010000:0.0:1783947696.451659:0:14185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947696.451664:0:14185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb3358 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.451671:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb3358 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.451685:0:14185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb335f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda1bae1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.451691:0:14185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb335f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda1bae1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.451696:0:14185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb335f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda1bae1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.451701:0:14185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c87949400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:0.0:1783947696.451703:0:14185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb335f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda1bae1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.451709:0:14185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb335f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda1bae1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.452916:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xda1bae1b (ffff8b3c8281bf00) 00010000:00010000:0.0:1783947696.452921:0:14185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947696.452927:0:14185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb335f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xda1bae1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.452933:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb335f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xda1bae1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947696.453183:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+26:14466:x1870604297953920:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 3764us (4045us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783947696.453193:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:3.0:1783947696.456713:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947696.457743:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297954048 00000100:00100000:0.0:1783947696.457759:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297954048 00000100:00100000:0.0:1783947696.457888:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:0.0:1783947696.457898:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+26:14466:x1870604297954048:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947696.457922:0:14186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947696.457947:0:14186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb3366 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab4fe expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.457983:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949e00/0x20c3e53e78bb336d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.457997:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949e00/0x20c3e53e78bb336d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.458016:0:14186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949e00/0x20c3e53e78bb336d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.458144:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb3366 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4fe expref: 28 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.458167:0:14186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949e00/0x20c3e53e78bb336d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4fe expref: 27 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.458177:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b3c8281b900) 00010000:00010000:0.0:1783947696.458186:0:14186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783947696.458191:0:14186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c87949e00, rc 0) 00000100:00100000:0.0:1783947696.458324:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+27:14466:x1870604297954048:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 426us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947696.458331:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:1.0:1783947696.461813:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947696.461923:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297954304 00000100:00100000:0.0:1783947696.461942:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297954304 00000100:00100000:2.0:1783947696.462326:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:2.0:1783947696.462342:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+27:14466:x1870604297954304:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783947696.462482:0:14184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3374 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.462504:0:14184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3374 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.462518:0:14184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3374 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947696.463079:0:14184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1783947696.463092:0:14184:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 511733672473ns, next at 512733669866ns, rc = 0 00000004:00010000:2.0:1783947696.463205:0:14184:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009c0cde25 reply state 0000000007c13e52 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3374 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947696.463216:0:14184:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783947696.463500:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+29:14466:x1870604297954304:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 1157us (1699us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1783947696.463510:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 46 00010000:00010000:2.0:1783947696.465845:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3374 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.465870:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3374 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.465879:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3374 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.465910:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147ca00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947696.465916:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3374 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.465925:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3374 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.465948:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b3c8281b900) 00010000:00010000:2.0:1783947696.465951:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783947696.465957:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3374 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.465964:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3374 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947696.466078:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947696.466351:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297954432 00000100:00100000:0.0:1783947696.466365:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297954432 00000100:00100000:0.0:1783947696.466463:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:0.0:1783947696.466475:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+28:14466:x1870604297954432:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947696.466676:0:14186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947696.466700:0:14186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb337b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab505 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.466792:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb337b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab505 expref: 29 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.466807:0:14186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb337b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab505 expref: 29 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.466827:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b3c8281b900) 00010000:00010000:0.0:1783947696.466830:0:14186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947696.466833:0:14186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c87949400, rc 0) 00000100:00100000:0.0:1783947696.466947:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+29:14466:x1870604297954432:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 474us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947696.466956:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:3.0:1783947696.469320:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947696.470272:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297954560 00000100:00100000:2.0:1783947696.470288:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297954560 00000100:00100000:2.0:1783947696.470388:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:2.0:1783947696.470401:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+5:2353:x1870604297954560:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783947696.470974:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+6:2353:x1870604297954560:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 571us (1664us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1783947696.470984:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:1.0:1783947696.473221:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947696.473324:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297954816 00000100:00100000:2.0:1783947696.473336:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297954816 00000100:00100000:2.0:1783947696.473466:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:2.0:1783947696.473481:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c83377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+29:14466:x1870604297954816:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783947696.474013:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c83377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+30:14466:x1870604297954816:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 535us (803us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1783947696.474041:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:1.0:1783947696.477361:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947696.477523:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297955072 00000100:00100000:2.0:1783947696.477536:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297955072 00000100:00100000:2.0:1783947696.477745:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:0.0:1783947696.477752:0:14185:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783947696.477759:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+30:14466:x1870604297955072:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783947696.477770:0:14185:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1783947696.478208:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+30:14466:x1870604297955072:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 450us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947696.478219:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:3.0:1783947696.484351:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947696.484459:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297955200 00000100:00100000:0.0:1783947696.484473:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297955200 00000100:00100000:0.0:1783947696.484871:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:0.0:1783947696.484887:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+30:14466:x1870604297955200:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947696.484918:0:14186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947696.484948:0:14186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb3382 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab50c expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.485051:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb3389 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.485069:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb3389 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.485084:0:14186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb3389 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947696.485153:0:14186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783947696.485189:0:14186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb3389 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.485224:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb3382 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab50c expref: 32 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.485265:0:14186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb3389 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab50c expref: 31 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.485276:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b3c8281b900) 00010000:00010000:0.0:1783947696.485279:0:14186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783947696.485304:0:14186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3c87949800, rc 0) 00000100:00100000:0.0:1783947696.485396:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+31:14466:x1870604297955200:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 514us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947696.485406:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:3.0:1783947696.492534:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947696.492762:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297955328 00000100:00100000:1.0:1783947696.492785:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297955328 00000100:00100000:1.0:1783947696.493220:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:1.0:1783947696.493233:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+6:2354:x1870604297955328:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947696.493268:0:14822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947696.493299:0:14822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e50c360/0x20c3e53e78bb3390 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab513 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783947696.493333:0:14822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54e1af, blocks: 0x1 00010000:00010000:1.0:1783947696.493362:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=511s v=(0 0) 00010000:00010000:1.0:1783947696.493368:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947696.493379:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e50c360/0x20c3e53e78bb3390 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab513 expref: 7 pid: 14822 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.493706:0:14822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e50c360/0x20c3e53e78bb3390 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab513 expref: 7 pid: 14822 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.493723:0:14822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73a600, rc 0) 00000100:00100000:1.0:1783947696.493860:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+7:2354:x1870604297955328:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 629us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947696.493877:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:1.0:1783947696.498784:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947696.499252:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297955584 00000100:00100000:2.0:1783947696.499267:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297955584 00000100:00100000:2.0:1783947696.499361:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:2.0:1783947696.499374:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+31:14466:x1870604297955584:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783947696.499634:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+31:14466:x1870604297955584:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 262us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947696.499643:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:3.0:1783947696.504213:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947696.504347:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297955712 00000100:00100000:1.0:1783947696.504363:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297955712 00000100:00100000:1.0:1783947696.504543:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:1.0:1783947696.504565:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+31:14466:x1870604297955712:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783947696.569890:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:2.0:1783947696.570509:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:2.0:1783947696.570527:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1783947696.570536:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1783947696.570595:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1783947696.570842:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947696.570879:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b85bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319957888:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783947696.571973:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+14:14466:x1870604297955712:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 Request processed in 67399us (67761us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947696.571989:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:3.0:1783947696.574838:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947696.575293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947696.576110:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319957888 00000100:00100000:2.0:1783947696.576126:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319957888 00000100:00100000:2.0:1783947696.576258:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297955840 00000100:00100000:2.0:1783947696.576262:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297955840 00000100:00100000:2.0:1783947696.576288:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783947696.576299:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b85bc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319957888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1783947696.577202:0:14821:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783947696.577229:0:14821:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1783947696.577231:0:14821:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783947696.577233:0:14821:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783947695 -> 1783947695 00002000:00010000:2.0:1783947696.577245:0:14821:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1783947696.577356:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b85bc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1870604319957888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1057us (2527us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1783947696.577366:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783947696.577414:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00080000:3.0:1783947696.578909:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947696.579126:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+7:2353:x1870604297955840:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1783947696.579296:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+7:2353:x1870604297955840:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 Request processed in 295us (4006us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947696.579306:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00000004:00080000:1.0:1783947696.579704:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b3b85bc6300/2, rc 0, transno 8589934595 00000100:00100000:1.0:1783947696.579716:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b85bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319957888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783947696.584644:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947696.584934:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297956096 00000100:00100000:2.0:1783947696.584950:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297956096 00000100:00100000:2.0:1783947696.585038:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:2.0:1783947696.585050:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+14:14466:x1870604297956096:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783947696.585124:0:14184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947696.585161:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb3389 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab50c expref: 14 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.585185:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b3c8281b900) 00010000:00010000:2.0:1783947696.585192:0:14184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947696.585244:0:14184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3397 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.585262:0:14184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3397 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.585299:0:14184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3397 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783947696.585671:0:14184:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000090054aa4 reply state 00000000439d2060 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3397 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947696.585684:0:14184:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783947696.585836:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+15:14466:x1870604297956096:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 787us (1207us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1783947696.585846:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:0.0:1783947696.590539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947696.590901:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297956224 00000100:00100000:1.0:1783947696.590914:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297956224 00000100:00100000:1.0:1783947696.590990:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:1.0:1783947696.591002:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+7:14466:x1870604297956224:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947696.591414:0:14822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947696.591581:0:14822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f0ace22/0x20c3e53e78bb339e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6acfb7f9852ab51a expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.591628:0:14822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e50c360/0x20c3e53e78bb3390 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab513 expref: 8 pid: 14822 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.591639:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947696.591644:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947696.591650:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f0ace22/0x20c3e53e78bb339e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab51a expref: 8 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.591693:0:14822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e50c360/0x20c3e53e78bb3390 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab513 expref: 8 pid: 14822 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.592147:0:14822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e50c360/0x20c3e53e78bb3390 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab513 expref: 8 pid: 14822 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947696.592169:0:14822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb60a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14822:1870604319958016:192.168.203.32@tcp:104: 00000100:00100000:1.0:1783947696.592327:0:14822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c9f5ad9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1783947696.592371:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3397 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.592382:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3397 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.592389:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3397 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.592396:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147ca00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:2.0:1783947696.592402:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3397 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.592410:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3397 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.592511:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b3c8281b900) 00010000:00010000:2.0:1783947696.592515:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947696.592521:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3397 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.592606:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147ca00/0x20c3e53e78bb3397 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947696.597676:0:14822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb60a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14822:1870604319958016:192.168.203.32@tcp:104: 00010000:00010000:1.0:1783947696.597733:0:14822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003f0ace22/0x20c3e53e78bb339e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab51a expref: 8 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.597762:0:14822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b3cad73bc00, rc 0) 00000100:00100000:3.0:1783947696.598087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947696.598186:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297956352 00000100:00100000:2.0:1783947696.598197:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297956352 00010000:00010000:2.0:1783947696.598260:0:14169:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e50c360/0x20c3e53e78bb3390 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab513 expref: 9 pid: 14822 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947696.598313:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:2.0:1783947696.598323:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+9:2353:x1870604297956352:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947696.598343:0:14169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947696.598377:0:14169:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e50c360/0x20c3e53e78bb3390 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab513 expref: 9 pid: 14822 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.598391:0:14169:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e50c360/0x20c3e53e78bb3390 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab513 expref: 9 pid: 14822 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.598462:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e50c360/0x20c3e53e78bb3390 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab513 expref: 9 pid: 14822 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.598485:0:14169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947696.598490:0:14169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947696.598499:0:14169:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f0ace22/0x20c3e53e78bb339e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab51a expref: 8 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.598536:0:14169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f0ace22/0x20c3e53e78bb339e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab51a expref: 8 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.598661:0:14169:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003f0ace22/0x20c3e53e78bb339e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab51a expref: 8 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947696.598679:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14169:1870604319958144:192.168.203.32@tcp:105: 00000100:00100000:0.0:1783947696.598797:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c83610c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947696.598827:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+8:14466:x1870604297956224:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 7828us (8304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947696.598836:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:3.0:1783947696.606786:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947696.607757:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297956480 00000100:00100000:2.0:1783947696.607784:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297956480 00000100:00100000:2.0:1783947696.607876:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:2.0:1783947696.607888:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+8:2354:x1870604297956480:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783947696.608155:0:14821:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783947696.608160:0:14821:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1783947695 00002000:00010000:2.0:1783947696.608162:0:14821:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1783947694 00002000:00010000:2.0:1783947696.608164:0:14821:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783947695 -> 1783947695 00002000:00010000:2.0:1783947696.608166:0:14821:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1783947696.608265:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+9:2354:x1870604297956480:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 380us (1494us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1783947696.608273:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:0.0:1783947696.608281:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14169:1870604319958144:192.168.203.32@tcp:105: 00010000:00010000:0.0:1783947696.608311:0:14169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947696.608335:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+8:2353:x1870604297956352:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 10014us (10330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947696.608343:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:1.0:1783947696.614311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947696.614371:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297956608 00000100:00100000:0.0:1783947696.614405:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297956608 00000100:00100000:0.0:1783947696.614512:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:0.0:1783947696.614524:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+8:2353:x1870604297956608:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783947696.614599:0:14822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000096c4b7a0/0x20c3e53e78bb33a5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.614651:0:14822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f0ace22/0x20c3e53e78bb339e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab51a expref: 8 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.614662:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947696.614668:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783947696.614674:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096c4b7a0/0x20c3e53e78bb33a5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.614721:0:14822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f0ace22/0x20c3e53e78bb339e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab51a expref: 8 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.614738:0:14822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f0ace22/0x20c3e53e78bb339e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab51a expref: 8 pid: 14822 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947696.614756:0:14822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14822:1870604319958272:192.168.203.32@tcp:104: 00000100:00100000:0.0:1783947696.614867:0:14822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c83610c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947696.619331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1783947696.619855:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297956736 00000100:00100000:3.0:1783947696.619868:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297956736 00010000:00010000:3.0:1783947696.619926:0:14170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f0ace22/0x20c3e53e78bb339e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab51a expref: 9 pid: 14822 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947696.619984:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:3.0:1783947696.620011:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+9:2353:x1870604297956736:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947696.620033:0:14170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947696.620064:0:14170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f0ace22/0x20c3e53e78bb339e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab51a expref: 9 pid: 14822 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.620081:0:14170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f0ace22/0x20c3e53e78bb339e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab51a expref: 9 pid: 14822 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.620113:0:14170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783947696.620119:0:14170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783947696.620127:0:14170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096c4b7a0/0x20c3e53e78bb33a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.620138:0:14170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096c4b7a0/0x20c3e53e78bb33a5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.620163:0:14170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947696.620248:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+9:2353:x1870604297956736:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 240us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947696.620258:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00010000:00010000:0.0:1783947696.622404:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f0ace22/0x20c3e53e78bb339e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab51a expref: 8 pid: 14822 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947696.622478:0:14822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14822:1870604319958272:192.168.203.32@tcp:104: 00010000:00010000:0.0:1783947696.622948:0:14822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000096c4b7a0/0x20c3e53e78bb33a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.622965:0:14822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000096c4b7a0/0x20c3e53e78bb33a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.622997:0:14822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096c4b7a0/0x20c3e53e78bb33a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.623046:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000096c4b7a0/0x20c3e53e78bb33a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.623056:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096c4b7a0/0x20c3e53e78bb33a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.623066:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096c4b7a0/0x20c3e53e78bb33a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.623074:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c87949000 already unused, calling callback (ffffffffc1552360) 00010000:00010000:0.0:1783947696.623079:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096c4b7a0/0x20c3e53e78bb33a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.623090:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096c4b7a0/0x20c3e53e78bb33a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.623113:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096c4b7a0/0x20c3e53e78bb33a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.623123:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096c4b7a0/0x20c3e53e78bb33a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947696.623262:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+7:2353:x1870604297956608:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 Request processed in 8739us (8968us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947696.623273:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:2.0:1783947696.626928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1783947696.627154:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297956992 00000100:00100000:0.0:1783947696.627168:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297956992 00000100:00100000:0.0:1783947696.627291:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:0.0:1783947696.627304:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c85c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+14:14466:x1870604297956992:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783947696.627476:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb33ac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.627510:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb33ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.627525:0:14186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb33ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.627900:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb33b3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.627913:0:14186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb337b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab505 expref: 15 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.627923:0:14186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb33b3 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.627973:0:14186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb337b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab505 expref: 15 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947696.628004:0:14186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb337b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab505 expref: 15 pid: 14186 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947696.628021:0:14186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14186:1870604319958400:192.168.203.32@tcp:104: 00000100:00100000:0.0:1783947696.628127:0:14186:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3c87a1a240 going to sleep for 11 seconds 00000100:00100000:0.0:1783947696.630567:0:14186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cbd03b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14186:1870604319958400:192.168.203.32@tcp:104: 00010000:00010000:0.0:1783947696.630607:0:14186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb33b3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947696.632413:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947696.632766:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297957120 00000100:00100000:1.0:1783947696.632778:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297957120 00010000:00010000:1.0:1783947696.632835:0:14171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb337b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab505 expref: 16 pid: 14186 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947696.632885:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:1.0:1783947696.632896:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+16:2354:x1870604297957120:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947696.632917:0:14171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947696.632925:0:14171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb337b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab505 expref: 16 pid: 14186 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.632941:0:14171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb337b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab505 expref: 16 pid: 14186 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.632990:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949400/0x20c3e53e78bb337b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab505 expref: 16 pid: 14186 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.633009:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b3c8281b900) 00010000:00010000:1.0:1783947696.633015:0:14171:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb33b3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.633026:0:14171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb33b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.633035:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb33b3 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.633068:0:14171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947696.633140:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+15:2354:x1870604297957120:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 245us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947696.633148:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00010000:00010000:3.0:1783947696.633324:0:14186:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb33b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.633333:0:14186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb33b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783947696.633637:0:14186:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1783947696.633831:0:14186:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1783947696.633880:0:14186:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1783947696.633985:0:14186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb65b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14186:1870604319958528:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783947696.637192:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947696.637326:0:14186:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb63d40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947696.637397:0:14189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319958528 00000100:00100000:2.0:1783947696.637408:0:14189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319958528 00000100:00100000:2.0:1783947696.637608:0:14189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947696.637618:0:14189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14186:x1870604319958528:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783947696.637784:0:14189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14186:x1870604319958528:12345-0@lo:1000:mdt00_002.0 Request processed in 168us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947696.637792:0:14189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947696.638350:0:14186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb65b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14186:1870604319958528:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1783947696.639590:0:14186:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1783947696.639680:0:14186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb65b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14186:1870604319958656:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783947696.639935:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947696.640026:0:14186:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb63d4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947696.640150:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319958656 00000100:00100000:0.0:1783947696.640159:0:14190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319958656 00000100:00100000:0.0:1783947696.640213:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947696.640222:0:14190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14186:x1870604319958656:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783947696.640448:0:14190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14186:x1870604319958656:12345-0@lo:1000:mdt00_002.0 Request processed in 227us (512us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1783947696.640455:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947696.640616:0:14186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb65b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14186:1870604319958656:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1783947696.640650:0:14186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb33b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.640660:0:14186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb33b3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.640668:0:14186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb33b3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.640673:0:14186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c87948400 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947696.640677:0:14186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb33b3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.640685:0:14186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb33b3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.640702:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b3c8281b900) 00010000:00010000:3.0:1783947696.640705:0:14186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783947696.640728:0:14186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb33b3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.640735:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87948400/0x20c3e53e78bb33b3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.640870:0:14186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb330b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.640878:0:14186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb330b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.640884:0:14186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb330b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.640890:0:14186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cc0630e00 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:3.0:1783947696.640893:0:14186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb330b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.640900:0:14186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb330b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.640908:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b3c98198f00) 00010000:00010000:3.0:1783947696.640911:0:14186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783947696.640918:0:14186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3312 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4e9 expref: 18 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.640929:0:14186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3312 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4e9 expref: 18 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.640939:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3312 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4e9 expref: 18 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.641075:0:14186:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630a00/0x20c3e53e78bb3312 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x6acfb7f9852ab4e9 expref: 18 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947696.641090:0:14186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb65b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14186:1870604319958784:192.168.203.32@tcp:105: 00000100:00100000:3.0:1783947696.641201:0:14186:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b3cb63d4180 going to sleep for 11 seconds 00000100:00100000:3.0:1783947696.646009:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947696.646386:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297957248 00000100:00100000:2.0:1783947696.646397:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297957248 00000100:00100000:2.0:1783947696.646471:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:2.0:1783947696.646480:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cc0a48450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+19:14465:x1870604297957248:12345-192.168.203.32@tcp:49:dd.0 00000100:00100000:2.0:1783947696.646605:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cc0a48450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+19:14465:x1870604297957248:12345-192.168.203.32@tcp:49:dd.0 Request processed in 126us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947696.646612:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:1.0:1783947696.646886:0:14186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb65b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14186:1870604319958784:192.168.203.32@tcp:105: 00010000:00010000:1.0:1783947696.646911:0:14186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb330b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.646922:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cc0630e00/0x20c3e53e78bb330b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.646958:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb33ba lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.646972:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb33ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.647004:0:14186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb33ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.647015:0:14186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb33ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.647022:0:14186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb33ba lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.647028:0:14186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb33ba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.647034:0:14186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a200 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947696.647038:0:14186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb33ba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.647044:0:14186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb33ba lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.647055:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b3c98198f00) 00010000:00010000:1.0:1783947696.647058:0:14186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947696.647061:0:14186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb33ba lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.647067:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3cad73a200/0x20c3e53e78bb33ba lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.647077:0:14186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb33ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.647083:0:14186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb33ac lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.647098:0:14186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb33ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.647103:0:14186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c87949800 already unused, calling callback (ffffffffc1f904f0) 00010000:00010000:1.0:1783947696.647106:0:14186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb33ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.647112:0:14186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb33ac lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.647120:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b3c98198f00) 00010000:00010000:1.0:1783947696.647122:0:14186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783947696.647124:0:14186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb33ac lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.647131:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c87949800/0x20c3e53e78bb33ac lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947696.647331:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c85c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+18:14466:x1870604297956992:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 20030us (20413us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1783947696.647341:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 53 00000020:00080000:1.0:1783947696.647345:0:14186:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783947696.647734:0:14219:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783947696.647739:0:14219:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947696.647776:0:14219:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783947696.647782:0:14219:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1783947696.657568:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947696.657986:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297957504 00000100:00100000:2.0:1783947696.658001:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297957504 00000100:00100000:2.0:1783947696.658074:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:2.0:1783947696.658086:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb65b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+18:14466:x1870604297957504:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783947696.658857:0:14187:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783947696.658967:0:14187:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1783947696.659017:0:14187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147de00/0x20c3e53e78bb33c1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.659035:0:14187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147de00/0x20c3e53e78bb33c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.659046:0:14187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147de00/0x20c3e53e78bb33c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.659053:0:14187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147de00/0x20c3e53e78bb33c1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.659060:0:14187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147de00/0x20c3e53e78bb33c1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.659073:0:14187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147de00/0x20c3e53e78bb33c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947696.659100:0:14187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783947696.659204:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb65b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+20:14466:x1870604297957504:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 1119us (1659us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1783947696.659214:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000020:00080000:2.0:1783947696.659219:0:14187:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783947696.659508:0:14173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947696.659517:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147de00/0x20c3e53e78bb33c1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.659525:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147de00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947696.659529:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147de00/0x20c3e53e78bb33c1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.659550:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147de00/0x20c3e53e78bb33c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.659566:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b3c8281b900) 00010000:00010000:1.0:1783947696.659569:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783947696.659574:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147de00/0x20c3e53e78bb33c1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.659581:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b3c8147de00/0x20c3e53e78bb33c1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.659595:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947696.659597:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947696.659599:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947696.885558:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947696.885636:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947696.885684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947696.885741:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297957632 00000100:00100000:1.0:1783947696.885752:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297957632 00000100:00100000:1.0:1783947696.885808:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297957760 00000100:00100000:1.0:1783947696.885812:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297957760 00000100:00100000:1.0:1783947696.885826:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297957888 00000100:00100000:1.0:1783947696.885838:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297957888 00000100:00100000:1.0:1783947696.885859:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:1.0:1783947696.885868:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb60a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+9:2356:x1870604297957632:12345-192.168.203.32@tcp:4:dd.0 00002000:00010000:1.0:1783947696.885917:0:14827:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a54e1af, atime: 0x6a54e1ae, ctime: 0x6a54e1af, blocks: 0x1 00010000:00010000:1.0:1783947696.885926:0:14827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb33c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.885969:0:14827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1783947696.885974:0:14827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947696.885981:0:14827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb33c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947696.885996:0:14827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb33c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947696.888464:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947696.888507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947696.888523:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947696.888536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1783947696.888552:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1783947696.888622:0:14825:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1783947696.888632:0:14825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1783947696.888766:0:14826:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1783947696.888784:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297958144 00000100:00100000:0.0:1783947696.888795:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297958144 00000100:00100000:0.0:1783947696.888864:0:14826:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1783947696.888871:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297958016 00000100:00100000:0.0:1783947696.888874:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297958016 00000100:00100000:0.0:1783947696.888902:0:14826:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1783947696.888915:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297958400 00000100:00100000:0.0:1783947696.888918:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297958400 00000100:00100000:0.0:1783947696.888930:0:14826:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1783947696.888934:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297958272 00000100:00100000:0.0:1783947696.888957:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297958272 00000100:00100000:0.0:1783947696.888973:0:14826:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1783947696.888978:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604297958528 00000100:00100000:0.0:1783947696.888980:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604297958528 00000100:00100000:3.0:1783947696.890350:0:16330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:3.0:1783947696.890367:0:16330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+15:2356:x1870604297957760:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:3.0:1783947696.890409:0:16330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.892279:0:16330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947696.892285:0:16330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947696.892293:0:16330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947696.892310:0:16330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783947697.046969:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:1.0:1783947697.047208:0:16330:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1783947697.047215:0:16330:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1783947695 -> 1783947696 00002000:00010000:1.0:1783947697.047218:0:16330:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783947695 -> 1783947696 00002000:00010000:1.0:1783947697.047221:0:16330:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:1.0:1783947697.047251:0:16330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.047267:0:16330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.047277:0:16330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.047309:0:16330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671a00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947697.047315:0:16330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.047326:0:16330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.047351:0:16330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33cf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.047359:0:16330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783947697.047595:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00010000:00010000:2.0:1783947697.047716:0:14827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb33c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947697.047726:0:14827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb33c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947697.047733:0:14827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb33c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947697.047739:0:14827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a200 already unused, calling callback (ffffffffc1552360) 00010000:00010000:2.0:1783947697.047742:0:14827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb33c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947697.047751:0:14827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb33c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947697.047774:0:14827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb33c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947697.047782:0:14827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000564ca829/0x20c3e53e78bb33c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947697.047998:0:16330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+12:2356:x1870604297957760:12345-192.168.203.32@tcp:4:dd.0 Request processed in 157627us (162350us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1783947697.048013:0:16330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:1.0:1783947697.048055:0:16330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:1.0:1783947697.048094:0:16330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+11:2356:x1870604297957888:12345-192.168.203.32@tcp:4:dd.0 00002000:00010000:1.0:1783947697.048150:0:16330:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6a54e1b0, atime: 0x6a54e1ae, ctime: 0x6a54e1b0, blocks: 0x1007 00010000:00010000:1.0:1783947697.048157:0:16330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb33d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.048173:0:16330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1783947697.048183:0:16330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947697.048200:0:16330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb33d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.048215:0:16330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb33d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783947697.048520:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947697.049532:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb60a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+11:2356:x1870604297957632:12345-192.168.203.32@tcp:4:dd.0 Request processed in 163654us (163973us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1783947697.049546:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:2.0:1783947697.049587:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:2.0:1783947697.049599:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+10:2355:x1870604297958144:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:2.0:1783947697.049755:0:14827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040f79462/0x20c3e53e78bb33dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947697.049772:0:14827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947697.049777:0:14827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947697.049784:0:14827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040f79462/0x20c3e53e78bb33dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947697.049799:0:14827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040f79462/0x20c3e53e78bb33dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947697.084283:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783947697.135905:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1783947697.142293:0:14827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 5242880 00002000:00010000:1.0:1783947697.142310:0:14827:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:1.0:1783947697.142333:0:14827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040f79462/0x20c3e53e78bb33dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.142351:0:14827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040f79462/0x20c3e53e78bb33dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.142362:0:14827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040f79462/0x20c3e53e78bb33dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.142371:0:14827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c8147da00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947697.142377:0:14827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040f79462/0x20c3e53e78bb33dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.143212:0:14827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040f79462/0x20c3e53e78bb33dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.143258:0:14827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040f79462/0x20c3e53e78bb33dd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.143268:0:14827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040f79462/0x20c3e53e78bb33dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947697.143461:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+13:2355:x1870604297958144:12345-192.168.203.32@tcp:4:dd.0 Request processed in 93821us (254960us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1783947697.143475:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:1.0:1783947697.143529:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1783947697.143558:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+12:2355:x1870604297958016:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:1.0:1783947697.143606:0:14827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb33e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.143623:0:14827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947697.143629:0:14827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947697.143751:0:14827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb33e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.143768:0:14827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb33e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783947697.202507:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00010000:00010000:1.0:1783947697.209295:0:16330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb33d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.209321:0:16330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb33d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.209331:0:16330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb33d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.209365:0:16330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73a000 already unused, calling callback (ffffffffc1552360) 00010000:00010000:1.0:1783947697.209370:0:16330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb33d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.209381:0:16330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb33d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.209407:0:16330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb33d6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.209449:0:16330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ce78da8/0x20c3e53e78bb33d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947697.209999:0:16330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+12:2356:x1870604297957888:12345-192.168.203.32@tcp:4:dd.0 Request processed in 161925us (324305us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1783947697.210014:0:16330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:1.0:1783947697.210065:0:16330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:1.0:1783947697.210081:0:16330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+11:2355:x1870604297958400:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:1.0:1783947697.210129:0:16330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb33eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.210146:0:16330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947697.210151:0:16330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947697.210159:0:16330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb33eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.210190:0:16330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb33eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783947697.265281:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:3.0:1783947697.267768:0:14827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:3.0:1783947697.267780:0:14827:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:3.0:1783947697.267800:0:14827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb33e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.267838:0:14827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb33e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.267848:0:14827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb33e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.267857:0:14827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73ac00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947697.267862:0:14827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb33e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.267872:0:14827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb33e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.267898:0:14827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb33e4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.267907:0:14827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f00c6bdb/0x20c3e53e78bb33e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947697.269329:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+11:2355:x1870604297958016:12345-192.168.203.32@tcp:4:dd.0 Request processed in 125775us (380807us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1783947697.269346:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:3.0:1783947697.269392:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:3.0:1783947697.269408:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+10:2355:x1870604297958272:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:3.0:1783947697.269464:0:14827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb33f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.269495:0:14827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947697.269500:0:14827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947697.269507:0:14827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb33f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.269522:0:14827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb33f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783947697.366105:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00010000:00010000:3.0:1783947697.366588:0:16330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb33eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.366607:0:16330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb33eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.366617:0:16330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb33eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.366627:0:16330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3cad73b600 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947697.366633:0:16330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb33eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.366644:0:16330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb33eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.366670:0:16330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb33eb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.366692:0:16330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000099b04e6/0x20c3e53e78bb33eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947697.366805:0:16330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+10:2355:x1870604297958400:12345-192.168.203.32@tcp:4:dd.0 Request processed in 156723us (478272us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1783947697.366817:0:16330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:3.0:1783947697.366858:0:16330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:3.0:1783947697.366874:0:16330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+9:2355:x1870604297958528:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:3.0:1783947697.366916:0:16330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.366931:0:16330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947697.366936:0:16330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947697.366944:0:16330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.366957:0:16330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783947697.449742:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:3.0:1783947697.450561:0:14827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1783947697.450568:0:14827:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1783947697.450587:0:14827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb33f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.450602:0:14827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb33f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.450630:0:14827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb33f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.450638:0:14827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671800 already unused, calling callback (ffffffffc1552360) 00010000:00010000:3.0:1783947697.450644:0:14827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb33f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.450654:0:14827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb33f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.450680:0:14827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb33f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.450689:0:14827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009509ce4f/0x20c3e53e78bb33f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947697.450819:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+9:2355:x1870604297958272:12345-192.168.203.32@tcp:4:dd.0 Request processed in 181412us (562273us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1783947697.450833:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00002000:00010000:2.0:1783947697.520640:0:16330:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1783947697.520670:0:16330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947697.520685:0:16330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947697.520696:0:16330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947697.520704:0:16330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b3c85671a00 already unused, calling callback (ffffffffc1552360) 00010000:00010000:2.0:1783947697.520709:0:16330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947697.520720:0:16330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947697.520743:0:16330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947697.520752:0:16330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ed9e93e/0x20c3e53e78bb33f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947697.520884:0:16330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e8f82e6-3a05-4e4f-a9c9-4ac9ea7c8746+7:2355:x1870604297958528:12345-192.168.203.32@tcp:4:dd.0 Request processed in 154009us (632321us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1783947697.520897:0:16330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000001:00080000:2.0:1783947697.520984:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00000040:00080000:2.0:1783947697.657920:0:14219:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783947697.657935:0:14219:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947697.657976:0:14219:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783947697.657983:0:14219:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1783947698.109502:0:14172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947698.234557:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947698.234591:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3c85c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319958912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947698.234700:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947698.235458:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb65b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319959424:0@lo:400:kworker.0 00000100:00100000:0.0:1783947698.235513:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947698.235561:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783947698.235567:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb65b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9e11f6c7-2161-442e-ac38-f4342317f92b:3311:1870604319959040:0@lo:400:kworker.0 00000100:00100000:0.0:1783947698.235603:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947698.235629:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb65b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319959552:0@lo:400:kworker.0 00000100:00100000:0.0:1783947698.235667:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947698.235703:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319959424 00000100:00100000:0.0:1783947698.235713:0:16328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319959424 00000100:00100000:0.0:1783947698.235777:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319959552 00000100:00100000:0.0:1783947698.235780:0:16328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319959552 00000100:00100000:0.0:1783947698.235806:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783947698.235816:0:16328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd03b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319959424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947698.235884:0:16328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd03b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870604319959424:12345-0@lo:400:kworker.0 Request processed in 69us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947698.235893:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783947698.235913:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783947698.235920:0:16328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3b850d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319959552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947698.235949:0:16328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3b850d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870604319959552:12345-0@lo:400:kworker.0 Request processed in 30us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947698.235955:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1783947698.235992:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947698.236032:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb65b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1870604319959552:0@lo:400:kworker.0 00000100:00100000:0.0:1783947698.236044:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb65b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1870604319959424:0@lo:400:kworker.0 00000100:00100000:1.0:1783947698.238706:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb65b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319959168:0@lo:400:kworker.0 00000100:00100000:1.0:1783947698.239785:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947698.239869:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947698.239884:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3cb65b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319959296:0@lo:400:kworker.0 00000100:00100000:1.0:1783947698.239926:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947698.239978:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319959040 00000100:00100000:1.0:1783947698.239989:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319959040 00000100:00100000:1.0:1783947698.240056:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783947698.240066:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3c9e6d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+19:3311:x1870604319959040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947698.240379:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3c9e6d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e11f6c7-2161-442e-ac38-f4342317f92b+19:3311:x1870604319959040:12345-0@lo:400:kworker.0 Request processed in 313us (4773us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947698.240388:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783947698.240581:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319959168 00000100:00100000:3.0:1783947698.240587:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319959168 00000100:00100000:3.0:1783947698.240634:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783947698.240642:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319959168:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783947698.240742:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947698.240757:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319959296 00000100:00100000:0.0:1783947698.240761:0:16328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319959296 00000100:00100000:0.0:1783947698.240792:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783947698.240799:0:16328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319959296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947698.242731:0:14824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319958912 00000100:00100000:2.0:1783947698.242751:0:14824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319958912 00000100:00100000:2.0:1783947698.242851:0:14824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783947698.242862:0:14824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cb6587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319958912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783947698.242894:0:14824:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3859808256 avail 3849322496 00000100:00100000:2.0:1783947698.242978:0:14824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870604319958912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (8279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947698.242987:0:14824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1783947698.243028:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947698.247662:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870604319959168:12345-0@lo:400:kworker.0 Request processed in 6832us (7694us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947698.247713:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783947698.247979:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1783947698.247987:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b3b85bc6300, transno 8589934595 00000004:00080000:3.0:1783947698.248001:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1783947698.248050:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3c85c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1870604319958912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947698.248955:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb65b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9e11f6c7-2161-442e-ac38-f4342317f92b:3311:1870604319959040:0@lo:400:kworker.0 00000100:00100000:0.0:1783947698.251163:0:16328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cb6585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870604319959296:12345-0@lo:400:kworker.0 Request processed in 10349us (11220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947698.251183:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783947698.251353:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb65b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870604319959296:0@lo:400:kworker.0 00000100:00100000:0.0:1783947698.251463:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3cb65b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1870604319959168:0@lo:400:kworker.0 00010000:00010000:0.0:1783947699.129819:0:14173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783947699.237530:0:16370:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1783947700.153746:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947700.797315:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947700.797350:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b3b850d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319959680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947700.797481:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947700.797567:0:14824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604319959680 00000100:00100000:0.0:1783947700.797578:0:14824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604319959680 00000100:00100000:0.0:1783947700.797654:0:14824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783947700.797665:0:14824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b3cbd4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319959680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947700.797714:0:14824:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783947700.797767:0:14824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b3cbd4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870604319959680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947700.797775:0:14824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1783947700.797815:0:14180:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947700.797871:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b3b850d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1870604319959680:0@lo:13:osp-pre-0-0.0 Debug log: 29478 lines, 29478 kept, 0 dropped, 0 bad.